AI News HubLIVE

Research updates

The AI Slot Machine Effect: Why Generative Feeds Disrupt Deep Work And How to Reclaim Focus

This article explores how generative AI tools create variable reward loops that fragment attention and hinder deep work, and provides strategies to protect focus in an AI-driven workplace.

  • Generative AI interfaces reward continued engagement over task completion, creating time sinks.
  • While AI boosts efficiency in some domains, it can increase workload in judgment-heavy tasks.
In-site article

We spent months building AI agents. Then we deleted them

Runnit's team built multiple specialized AI agents due to model context limitations, but after newer models with larger context windows, they realized a single intelligence architecture was simpler and more effective, so they deleted all agents.

  • Initially, they built separate agents for planning, research, scheduling, and writing due to small context windows.
  • Newer LLMs with larger contexts can naturally switch tasks, making separate agents unnecessary.
In-site article

China’s Low-Priced Z.ai Model Is Exposing Costly Coder Habits

Z.ai's GLM 5.2 model challenges U.S. frontier AI with low cost and open weights, but many programmers still habitually use expensive models, ignoring costs. The model benchmarks close to Claude Opus 4.8 in some areas, but real-world experiences vary.

  • GLM 5.2 API costs $4.40 per million output tokens, less than a fifth of Anthropic Opus 4.8 and a tenth of Fable
  • Open weights allow self-hosting, addressing data privacy concerns
In-site article

Software and AI – Plotting vs. Pantsing

This article explores how the two approaches in software development—plotting (top-down planning) and pantsing (bottom-up coding)—affect the use of AI tools. The author argues that AI delegates (autonomous) suit plotting, while AI assistants (collaborative) suit pantsing. In existing codebases, pantsing builds understanding and delegates hinder learning; in greenfield projects, delegates are less risky but may still rob programming of joy by removing the 'play to learn' process. The key is to match AI style to the current development phase.

  • Software development mirrors fiction writing with plotting vs pantsing styles.
  • AI delegates support plotting; AI assistants support pantsing.
In-site article

I reviewed 7 free AI tools for small businesses – feedback welcome

This article reviews seven free AI tools for small businesses, covering comparisons of Perplexity vs ChatGPT, AI for SME digitalization, Bolt.new for web development, Buffer vs Hootsuite for social media management, Calendly for scheduling, Hotjar for user behavior analysis, and Trello vs Notion vs Asana for project management. The author shares insights on how these tools can boost productivity and digital transformation for small businesses.

  • Perplexity vs ChatGPT comparison for business research
  • AI guide for SME digitalization
In-site article

Best tablets for note-taking 2026: Expert tested and reviewed

We've tested and reviewed the best tablets for note-taking, featuring top picks from Apple, Amazon, and more for students, professionals, and creative users.

  • Note-taking tablets offer stylus support and features like annotation, syncing, collaboration.
  • Our top pick is lightweight and compatible with Apple Pencil.
In-site article

Was Hugging Face Breached by AI Agents?

Hugging Face suffered a real breach where an autonomous AI agent system gained unauthorized access to internal datasets and credentials, highlighting a new cybersecurity threat from self-operating AI agents that can attack 24/7 without human intervention.

  • Hugging Face was breached by autonomous AI agents accessing internal data and credentials.
  • Agentic attackers use self-operating AI that plans, adapts, and attacks continuously.
In-site article

AI Nutrition Facts

With AI-generated content proliferating, work artifacts are filled with potential hallucinations and errors—'AI slop.' The author suggests adding disclosures to clarify AI usage, like 'nutrition facts,' to help colleagues assess trustworthiness and self-reflect on judgment gaps.

  • AI-augmented work is here to stay, but AI output can be flawed, increasing reviewers' cognitive burden.
  • Propose adding footnotes or labels to documents and PRs indicating how AI was used.
In-site article

Election voting advice from AI chatbots ‘inaccurate and unreliable’

Research during Hungary election shows AI recommended parties not running and gave highly volatile answers to identical prompts

  • AI chatbots gave inaccurate voting advice in Hungarian election study
  • They recommended parties not running and gave inconsistent answers
In-site article

Differentiable Reinforcement Learning for Path Tracking by an Agile Fish-Like Robot

Fish-like swimming has inspired dozens to hundreds of bioinspired robots, but control and motion planning remain challenging due to poorly modeled fluid-structure interaction and underactuated dynamics. This work develops a computationally efficient simulation platform and uses differentiable reinforcement learning with backpropagation through time and curriculum training to learn variable PID gains. The learned policy transfers seamlessly to the physical robot, showing excellent match.

  • Fish-like robots face control challenges due to fluid-structure interaction and underactuated dynamics
  • A computationally efficient simulation platform approximates robot motion
In-site article

Foresight Residual RL for Long-Horizon Robot Manipulation with Vision-Language-Action Models

This paper proposes Foresight Residual RL, which improves long-horizon robot manipulation success by augmenting each subtask's sparse success reward with an offline-estimated foresight value—the probability of future subtask success conditioned on the terminal state of the current subtask. On a three-phase wrench-based nut-tightening task in Isaac Gym, it achieves 85.6% full-task success, outperforming standard subtask residual RL (54.5%) and VLA baselines.

  • VLA policies fail on tight-tolerance assembly due to long-horizon credit assignment and subtask coupling
  • Standard residual RL optimizes each subtask in isolation but yields little gain when chained due to uncontrolled terminal state quality
In-site article

Certifiable Safe Model-Based Reinforcement Learning with Control-Affine Dynamics Approximation

A safe model-based reinforcement learning framework is proposed that learns control-affine dynamics and uses adaptive conformal prediction for uncertainty quantification, combined with control barrier functions for certifiable safety. Simulations on cartpole and 3D quadrotor demonstrate effectiveness.

  • Learns control-affine dynamics using Control-Affine Random Fourier Features (ARFF) for computational efficiency.
  • Applies adaptive conformal prediction to quantify uncertainty in safety constraints from learned dynamics.
In-site article

Linear Stability Analysis of an INDI Pitch-Rate Controller under Model Mismatch for a Tilt-Rotor VTOL UAV

This paper analyzes the linear stability of an INDI pitch-rate controller under model mismatch for a tilt-rotor VTOL UAV. A closed-form fifth-order transfer function is derived, and stability is characterized using the Routh-Hurwitz criterion. Two tuning procedures are proposed: robustness-oriented and performance-oriented. Control-effectiveness mismatch, especially sign errors, is identified as the most destabilizing factor.

  • Derived a closed-form fifth-order transfer function for the controller-estimator-actuator-plant interconnection
  • Characterized stability regions through three-parameter sweeps using the Routh-Hurwitz criterion
In-site article

Back to the museum: Investigation of the acceptance of Android Andrea with and without emotion simulation in a museum

A study revisited the android robot Andrea at a German museum for six days, engaging visitors in multilingual conversations. Three emotion simulation conditions (none, ChatGPT 4.1, WASABI) were tested with 73 visitors. Results showed no positive effect or conscious detection of the emotion simulations.

  • Android robot Andrea returned to a museum for a second time, now multilingual and context-aware.
  • Three emotion conditions: no emotions, ChatGPT 4.1-driven, WASABI architecture.
In-site article

PRISM: Multimodal Terrain Mapping for Rover Navigation in Unstructured Environments

PRISM is a multimodal perception system that integrates thermal, optical, and depth sensors with a novel vision transformer network (OmniUnet) for terrain segmentation and traversability mapping. Validated on two new datasets and deployed on an embedded computer, it enables autonomous rover navigation in challenging terrain.

  • PRISM fuses RGB, depth, and thermal imagery for enhanced terrain perception.
  • OmniUnet, a vision transformer-based network, performs multimodal semantic segmentation.
In-site article

S.E.A.G.R: A Socially and Emotionally Aware Greeting Robot Framework with Dual-Layer Cultural and Affective Modulation

This paper presents SEAGR, a robot greeting framework for users from diverse cultural backgrounds and emotional states. It uses a dual-layer modulation where cultural identity determines greeting type and affective cues modulate execution, integrating cultural mapping, emotion-based gestures, and proxemics in a Sense-Think-Act architecture. A low-cost prototype is built; however, empirical validation via user studies is currently lacking.

  • SEAGR introduces a dual-layer modulation framework: cultural identity selects greeting type, affective cues adjust execution
  • System integrates cultural mapping, emotion-based gesture modulation, and proxemic regulation
In-site article

Real-Time sEMG-Based Telecontrol of an Assistive Robotic Arm Using a 1D Convolutional Neural Network

This research presents a real-time sEMG-based interface for teleoperating an assistive robotic arm. Using a 1D convolutional neural network, the system achieves over 90% classification accuracy and stable control with an average latency of 0.32 seconds in both simulated and real environments, demonstrating the feasibility of sEMG-based telecontrol for assistive robotics.

  • Real-time control of an assistive robotic arm using four-channel sEMG and a 1D CNN
  • Classification accuracy above 90% with average latency of 0.32 seconds
In-site article

Control Design for a Rideable Animatronic Two-Wheeled Robot with Quadruped Form

To revive interest in motorcycles among younger generations, researchers developed a rideable two-wheeled robot with four limbs that exhibits dynamic quadrupedal gait. The robot uses a self-balancing wheeled base for primary locomotion, with limbs providing auxiliary support and coordinated motion, enabling intuitive weight-shift control. This paper focuses on robust balancing control and motion strategies for natural quadruped-like behavior.

  • The robot combines wheeled self-balancing with quadruped limb assistance to reduce motor output and weight.
  • The limbs maintain stability even during rapid motions.
In-site article

HyperDCM: Dynamic Cluster Memory Replay in Hyperbolic Space for Continual Robotic Navigation Across Scenes

To address catastrophic forgetting in visual navigation, researchers propose HyperDCM, a structure-aware memory mechanism. It uses large vision-language models to extract scene triples, encodes them via R-GCN into scene graph embeddings, and projects into hyperbolic space for structural separability. Dynamic clustering and structure-sensitive update select representative samples for replay, preserving knowledge diversity. Experiments on multi-scene datasets show superior retention and generalization over baselines.

  • HyperDCM enhances diffusion policy navigation with scene graph modeling and memory replay.
  • Uses large vision-language models and R-GCN to extract and encode scene semantics.
In-site article

Depth Estimators Are Implicit Neural Fields for 3D Scene Geometry Inpainting and Reconstruction

This paper proposes Neural Depth Field (NDF), which treats depth estimators as scene-level implicit fields. Through a single test-time optimization, it resolves inconsistencies and unreliability issues. Experiments show NDF reduces cross-view inconsistency by 63.3% and improves inpainting accuracy by 23.1%, achieving state-of-the-art performance.

  • NDF unifies depth estimation and implicit neural fields via test-time optimization.
  • Reduces cross-view inconsistency by 63.3% and improves inpainting accuracy by 23.1%.
In-site article

A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognition

A shared latent approach for partially-labeled multi-task facial affect recognition using a variational bottleneck. On s-Aff-Wild2, it improves expression macro-F1 from 0.403 to 0.446 and breaks the action-unit ceiling with a second backbone.

  • Casts partially-labeled multi-task learning as marginalization over a shared affect latent, with a variational bottleneck mediating three task decoders.
  • Achieves expression macro-F1 of 0.446 on s-Aff-Wild2 (only 37% fully labeled), up from 0.403 of a dedicated specialist.
In-site article

MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understanding

The 3rd Micro-Action Analysis Grand Challenge (MAC 2026), held at ACM Multimedia 2026, advances micro-action analysis from recognition to fine-grained understanding by introducing a new task evaluated with multimodal large language models. The paper details datasets, protocols, competition results, and future directions for this emerging field.

  • MAC 2026 introduces fine-grained micro-action understanding task using multimodal LLMs.
  • The challenge moves beyond traditional recognition and detection to deeper interpretation of subtle human behaviors.
In-site article

GenSyn10: A Multi-Generative AI Dataset For Benchmarking Image Classification

GenSyn10 is a 60,000-image synthetic dataset aligned with CIFAR-10, generated by three architecturally diverse models to advance AI-generated image detection. Evaluation shows detectors perform well on known generators but degrade significantly on unseen ones, highlighting OOD generalization limitations.

  • GenSyn10 comprises 60,000 32x32 synthetic images across 10 classes, generated by FLUX.2-dev, HunyuanImage-3.0, and Qwen-Image-2512.
  • CIFAR-10-trained models achieve up to 96.86% zero-shot accuracy on GenSyn10, rising to 99.88% after fine-tuning.
In-site article

Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware

EMTS-Det is a lightweight system for real-time follow-me person tracking on drones, using ego-motion-normalized residual motion channels to detect persons with only 22k parameters and 7.6 MFLOPs. It achieves 31.85 FPS on a Raspberry Pi Zero 2W, significantly outperforming YOLOv8n (1.95 FPS, 0.172 AP25) while maintaining 0.462 AP25 and 0.714 recall.

  • EMTS-Det uses only 22k parameters and 7.6 MFLOPs for real-time person tracking on resource-constrained hardware.
  • Ego-motion-normalized residual-motion channels enable detection of small targets (10-60 pixels) cluttered with background.
In-site article

3D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism

Researchers propose 3D FaceShell, a framework that adds subtle perturbations to 3D face avatars to mislead vision-language models from inferring sensitive attributes while preserving visual identity.

  • 3D FaceShell applies learnable Gaussian shells to 3D avatars for privacy protection.
  • It redirects VLM attribute inference without altering human-recognizable appearance.
In-site article

A Step Forward Towards Trustworthy Risk-Aware Facial Retrieval (RA-FR)

Risk-Aware Facial Retrieval (RA-FR) is proposed to address reliability in unconstrained surveillance by moving from fixed Top-k to adaptive set generation, guaranteeing inclusion of the ground truth within user-specified risk and confidence levels.

  • RA-FR replaces fixed Top-k retrieval with adaptive set generation
  • Combines hybrid blind face restoration, self-supervised DINOv1 features, and conformal prediction
In-site article

The JEPA Predictor: A Transferable Operator for Occluded Feature Completion

Joint-Embedding Predictive Architectures (JEPAs) train a predictor jointly with their encoder, but downstream deployment discards the predictor. This research shows the JEPA predictor serves as a transferable operator for occluded feature completion, adaptable across encoder families via a linear projection, significantly improving occluded classification accuracy.

  • The JEPA predictor is a learned operator from visible-context features to masked positions, portable across encoder families.
  • Frozen predictors from I-JEPA and V-JEPA 2 are adapted to non-JEPA hosts (CLIP, DINOv3, DINOv2, MAE) via a single linear projection fitted on 500 ImageNet images.
In-site article

ForensicNet: Lightweight Attention-Enhanced MobileNetV2 for Automated Face Identification

ForensicNet is a lightweight deep learning framework for forensic face recognition, combining MobileNetV2 with CBAM attention. It achieves 92.4% accuracy on LFW and SCFace datasets with only 2.1 GFLOPs per inference, enabling real-time forensic surveillance applications.

  • Integrates MobileNetV2 with CBAM attention for efficient feature learning
  • Two-phase transfer learning with adaptive layer unfreezing reduces overfitting
In-site article

Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation

This paper introduces Scientific Feasibility Control (SFC), a graph-structured conformal prediction framework that provides statistical guarantees for scientific reasoning validity. SFC decomposes reasoning into atomic factuality units and uses dynamic branching to correct errors. On PhyX, it achieves 50.1% accuracy, outperforming DeepSeek-R1 and GPT-4, reduces scientific law violations by 73%, and provides 91.7% validity guarantees at α=0.10.

  • SFC models logical dependencies as approximate deducibility graphs using conformal prediction.
  • Dynamic branching reroutes generation when scientific violations are detected.
In-site article

Are Arithmetic Heuristic Neurons Form-Invariant? A Mechanistic Analysis of Symbols, Text, and Code in LLMs

Large language models often succeed on one formulation of a problem while failing on an equivalent formulation. Whether these failures arise from distinct internal circuits or different activation states of a shared circuit remains unknown. This study investigates whether arithmetic heuristic neurons are form-invariant across symbolic arithmetic, natural language word problems, and Python code in Llama-3 models. Using a two-stage pipeline of attribution patching and activation patching, we identify a compact set of neurons shared across all formats. Targeted interventions show this shared circuit is necessary and sufficient for late-layer arithmetic computation. Transferring activations from successful to failed executions recovers over 97% of errors for addition and subtraction, indicating cross-format failures arise from activation states rather than distinct circuits. Shared neurons consistently belong to the same heuristic families, demonstrating neuron-level form-invariance.

  • Used a two-stage pipeline combining attribution patching and activation patching to identify arithmetic heuristic neurons.
  • Found a compact set of neurons shared across symbolic, text, and code formats.
In-site article

SpecLA: Efficient Speculative Decoding for Linear-Attention Models

This paper presents SpecLA, a speculative decoding runtime for stateful linear-attention models. It verifies chains and trees with topology-aware kernels, stores compact factors to recover accepted states, and uses confidence pruning plus a target-aligned EAGLE-style drafter. On an NVIDIA H100 with a GDN-1.3B target, SpecLA achieves up to 1.70x end-to-end speedup over autoregressive decoding.

  • Linear-attention models replace KV cache with recurrent states, but decoding remains sequential.
  • Existing speculative decoders assume Transformer KV caches.
In-site article

OpenLanguageModel: Readable and Composable Small-Language-Model Pretraining for Education and Research

OpenLanguageModel (OLM) is an open-source PyTorch library for building and pretraining small language models with visible internals. Model code mirrors architecture using components like Block, Residual, Repeat, and Parallel. It integrates tokenizers, datasets, optimization, mixed precision, callbacks, checkpoints, and hardware-aware execution, enabling seamless transition from teaching notebooks to full pretraining. The library includes 27 presets across nine model families and documentation from fundamentals to research. Validation shows close agreement with reference implementations, 90.6% weak-scaling efficiency on four GPUs for a 348M-parameter model, and positive usability feedback. OLM is MIT-licensed and available on PyPI, GitHub, and its documentation site.

  • OLM provides readable model code that directly reflects architecture components for education and research.
  • It enables seamless movement from teaching notebooks to full pretraining runs with a complete pipeline.
In-site article

NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning

This paper presents the NOWJ team's methodologies across all five tasks of COLIEE 2026, including legal case retrieval, entailment, statute law retrieval, textual entailment, and judgment prediction, using adaptive pipelines and deep learning.

  • Four-stage pipeline for legal case retrieval with candidate filtering, dense retrieval, cross-encoder reranking, and adaptive cutoff
  • Legal case entailment combines BM25, T5 reranking, and LLM entailment verification
In-site article

Encoding EEG Signals to Examine Human-Like Next-Word Prediction Behaviour in Language Models

This study compares human and language model (LM) next-word prediction using EEG event-related potentials (ERPs), finding that only the 'surprisal' measure correlates with language-processing ERPs, especially for open-class words, and that scaling LMs does not guarantee more human-like cognitive processing.

  • LMs approach human accuracy in next-word prediction, but high accuracy may not reflect cognitive signals of reading comprehension.
  • Two information measures (top-1 prediction and surprisal) were used to model ERP patterns and assess cognitive plausibility of LMs.
In-site article

Committed Before Reasoning: Behavioral Reproduction and Preliminary Activation-Level Evidence of Answer Pre-Commitment in an Open-Weight LLM

A new study uses a simple car-wash question to reveal that language models often pre-commit to an answer before reasoning, failing to derive logically correct conclusions. Experiments on Qwen3-8B show systematic wrong commitments (recommending 'walk' when 'drive' is the only valid option). Activation-level analysis suggests hidden states already lean toward the wrong answer before output, even for rollouts that eventually answer correctly. The findings highlight a pre-reasoning decision bias in LLMs.

  • Qwen3-8B incorrectly recommends 'walk' in 85-100% of sampled rollouts for a simple logic task.
  • Hidden state analysis reveals pre-commitment bias toward 'walk' before answer generation, even in correct-answer rollouts.
In-site article

RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

Small language models in retrieval-augmented generation are highly sensitive to noisy evidence. This paper introduces RIMS, a three-stage preference optimization framework featuring synthetic chain-of-thought data generation, a differentiable soft aggregation mechanism, and preference optimization. Experiments show consistent gains on multi-hop QA benchmarks.

  • RIMS framework optimizes preference learning for small LMs via smoothed multi-pair aggregation
  • Synthetic preference data generated via rejection sampling using the target SLM itself
In-site article

Multi-level context Modeling for consistent expert selection in Mixture-of-Experts

Mixture-of-Experts (MoE) scales Transformers by routing tokens to a subset of experts, but existing routers use shallow or isolated token representations, leading to unstable and semantically inconsistent routing. This work proposes Multi-level Context Fusion MOE (MCF-MOE), which integrates cross-layer semantic aggregation and local token-level interactions for more context-aware representations. Experiments show improved routing consistency and downstream performance.

  • Existing MoE routers suffer from context incompleteness causing inconsistent expert selection.
  • MCF-MOE fuses cross-layer semantic and local token signals for better representations.
In-site article

HantaWatch: Federated Learning for Hantavirus Genomic Surveillance

A new federated learning framework called HantaWatch enables collaborative training of genomic surveillance models without sharing raw data, improving hantavirus outbreak prediction and expert prioritization.

  • HantaWatch uses federated learning to train models on distributed genomic data without centralizing sensitive sequences.
  • It integrates k-mer feature extraction, adaptive optimization, and prediction-only triage.
In-site article

Token-Level Cross-Modal Transformer with Contrastive Multi-Task Learning for Breast Cancer Subtype Classification and Survival Prediction

This paper proposes a token-level cross-modal transformer with contrastive multi-task learning to integrate genomic and clinical data for joint breast cancer subtype classification and survival prediction, overcoming limitations of coarse modality interaction, simple fusion, and independent optimization.

  • Existing methods treat each modality as a monolithic feature vector, preventing fine-grained token-level interactions.
  • Proposes token-level cross-modal transformer for structured token exchange.
In-site article

From Weights to Words: Expressing and Editing Preference Model Inferences in Natural Language

This paper introduces 'weights to words', a method that automatically discovers natural language-described preference dimensions from choice data, addressing under-determination and opacity in preference learning. Experiments show improved prediction accuracy and enable real-time user inspection and editing.

  • Proposes 'weights to words' method that extracts natural language preference dimensions automatically.
  • Demonstrates versatility across four domains: moral dilemmas, movies, wines, and LLM responses.
In-site article

Orthogonal Gradient Constraints Shape Noisy-Label Memorization Dynamics

A new study introduces OrthoGrad, a geometric intervention on gradient updates that removes the radial component of weight gradients. Experiments on noisy-label image classification show that OrthoGrad improves test accuracy in small-data regimes but does not prevent eventual memorization of corrupted labels. The method serves as a useful diagnostic for studying learning dynamics.

  • OrthoGrad modifies optimizer updates by projecting gradients orthogonal to weight vectors.
  • On MNIST with limited data, OrthoGrad boosts CNN test accuracy and reduces fitting of corrupted labels.
In-site article

RouteCost: A Production-Inspired Multi-Stage Framework for Pre-Order Shipping Cost Estimation in E-Commerce

Accurate pre-order shipping cost estimation is crucial in e-commerce. RouteCost introduces a multi-stage framework that decomposes the problem into time-aware demand forecasting, fee-card-informed baseline pricing, residual correction, and proxy-based box-consolidation inference. Evaluated on over 250,000 orders across 260 products and 18 months, it improves predictive quality and calibration while preserving route-level interpretability.

  • Pre-order shipping cost estimation is affected by distance, destination demand mix, billable weight, dimensional pricing, surcharge triggers, and shipment consolidation.
  • RouteCost decomposes the problem into four stages: time-aware demand forecasting, fee-card-informed baseline pricing, Stage 2 residual correction, and proxy-based box-consolidation inference.
In-site article

Operator-Aware Mixed-Precision Tolerance Calibration for Tensor Kernels

This paper proposes an operator-aware mixed-precision tolerance calibration method that mines accumulated cloud GPU run data to automatically determine optimal absolute tolerances for tensor kernel correctness tests, achieving much tighter tolerances than hand-picked ones and significantly improving bug-detection recall.

  • Current tensor-kernel tests use fixed hand-picked tolerances that are rarely updated.
  • Proposed method mines error distributions from cloud GPU runs to calibrate per-operator tolerances.
In-site article

LLM Unlearning for Cyber Defense: A Survey on Methods, Challenges, and Emerging Threats

LLMs deployed in critical systems pose risks due to their inability to forget sensitive data. This survey examines gradient-based unlearning methods, questioning whether they genuinely remove knowledge or merely suppress expression, highlighting security and robustness challenges.

  • LLM unlearning aims to remove targeted knowledge without retraining, addressing privacy and security risks.
  • Gradient-based methods dominate but may not achieve true forgetting, only suppression.
In-site article

Fully-sensorized smart-eyewear platform for on-device Machine Learning

This paper presents ARGO, a smart eyewear platform leveraging the STM32N6 microcontroller and its integrated NPU for on-device machine learning, minimizing latency and preserving privacy. Through holistic co-design of hardware, firmware, and AI, an optimized YOLOv11 model is deployed for real-time urban obstacle recognition, introducing Head-wise Parallel Attention (HPA) for efficient NPU execution. The model achieves mAP50-95 of 24 with only 2.483 MB memory footprint. The platform integrates multimodal sensors, runs at 10 FPS, and provides ~113 minutes of autonomy on a 200 mAh battery, demonstrating the feasibility of high-performance, privacy-preserving assistive devices.

  • ARGO smart eyewear uses STM32N6 MCU and NPU for on-device ML, avoiding cloud dependency
  • Head-wise Parallel Attention (HPA) optimizes YOLOv11 model for NPU, achieving mAP50-95 24 under tight memory
In-site article

DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth

This paper proposes DocOCR-Eval, an annotation-free evaluation framework for automatic OCR assessment and selection. It employs a three-staged correction and ranking strategy to approximate annotation-based tool ordering without ground-truth labels. Experiments show that aggregating multiple MLLMs improves alignment with human rankings, enabling reliable tool selection in label-limited settings.

  • DocOCR-Eval evaluates OCR tools without manual annotations.
  • Uses three-stage correction and ranking to approximate true order.
In-site article

Reinforcement Learning-Guided NSGA-II Enhanced with Gray Relational Coefficient for Multi-Objective Optimization: Application to NASDAQ Portfolio Optimization

This paper proposes a novel RL-guided NSGA-II algorithm enhanced with Gray Relational Coefficients (RL-NSGA-II-GRC) that improves convergence and diversity of Pareto fronts in multi-objective optimization. It achieves around 5.8% and 4.4% convergence improvements over NSGA-II on benchmarks and produces a smooth efficient frontier for NASDAQ portfolio optimization, identifying a maximum Sharpe ratio portfolio of 1.92.

  • Proposes RL-NSGA-II-GRC combining an RL agent for adaptive parameter control and GRC-based selection.
  • Designs a GRC-enhanced tournament operator considering dominance rank, crowding distance, and proximity to ideal reference.
In-site article

It Takes 8 Tokens: Weak-to-Strong Off-Policy RL via Auxiliary Branches

A new reinforcement learning method, W2SPO, uses weak auxiliary models to inject short segments into LLM reasoning paths, improving performance and training speed on math reasoning tasks.

  • Standard RL for LLMs suffers from semantic redundancy and limited support
  • W2SPO injects short auxiliary segments (as few as 8 tokens) into trajectories
In-site article

Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL

Recent growth in reinforcement learning (RL) requires diverse training environments. World models can simulate environment states, but autoregressive models suffer from left-to-right bias. Masked diffusion language models (MDLMs) overcome this via bidirectional anchor-aware denoising, achieving better coherence and rollout diversity than LLMs 4x their size. A GRPO training framework is introduced, achieving up to 47% absolute gains on zero-shot transfer to out-of-distribution environments. The dataset and code are open-sourced.

  • MDLMs outperform autoregressive LLMs in coherence and rollout diversity for text-based world modeling.
  • Bidirectional anchor-aware denoising enables conditioning on global state anchors.
In-site article

Generative Ontology Induction: Domain-Agnostic Schema Discovery from Document Corpora Using Large Language Models

This paper introduces Generative Ontology Induction (GOI), a domain-agnostic framework that induces a generative blueprint—entities, dimensions, properties, relationships, and constraints—from a corpus of examples and exports it as a typed graph (six node types, seven edge types) in YAML/JSON. A novel evaluation metric, Node Coverage Score, measures structural coverage. Validation on four diverse ontologies shows 95-100% coverage with GOI prompting, while a generic template drops significantly on unfamiliar domains.

  • GOI is a domain-agnostic ontology induction framework leveraging LLMs to discover schemas from document corpora.
  • Outputs a typed graph with six node types and seven edge types in YAML/JSON format, suitable for downstream pipelines.
In-site article

Topics

Research AI News | AI News Hub