AI News HubLIVE

Models updates

Quoting Linus Torvalds

Linus Torvalds asserts that Linux is not an anti-AI project and that AI, as a useful tool, is welcome in the Linux community. He challenges dissenters to fork the project or walk away.

  • Linus Torvalds firmly states Linux is not anti-AI.
  • He calls AI a clearly useful tool.
In-site article

Claude can now use your 1Password credentials for you

1Password has launched a new browser integration for Claude that allows the AI to access stored credentials via a zero-exposure security framework, enabling task automation without exposing passwords.

  • 1Password introduces a browser integration for Claude, allowing AI to use stored credentials.
  • Zero-exposure framework keeps passwords hidden from AI.
In-site article

SpaceXAI Open-Sources Grok Build: The Rust Agent Harness, TUI, and Tool Layer Behind Its Coding CLI

SpaceXAI open-sourced Grok Build on July 15, 2026. The Apache 2.0 Rust tree covers the agent loop, tool dispatch, the TUI, and the extension system. Grok 4.5 stays closed, and external contributions are not accepted.

  • Grok Build, the terminal-based AI coding agent behind grok CLI, is now open-sourced under Apache 2.0.
  • The released code includes agent harness, TUI, CLI shell, and developer tooling, organized into several Rust crates.
In-site article

Show HN: Free Ollama AI Trading Desktop App

VaultCharts is a free desktop trading app that combines charting tools with an AI assistant. It supports multiple AI models, is local-first, and allows users to analyze markets with or without AI assistance.

  • VaultCharts offers a free desktop trading app with charting tools and an AI assistant.
  • Users can bring their own AI model or use local models like Ollama.
In-site article

HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models

This paper introduces HRO, a hierarchical room-to-object framework for zero-shot object-goal navigation powered by large language models (LLMs). Unlike existing flat reasoning methods, HRO mimics human-like hierarchical spatial cognition, enabling the agent to explore from room-level to object-level in a coarse-to-fine manner. Experiments on Gibson and HM3D datasets demonstrate superior success rate and generalization over prior LLM-based approaches.

  • Existing zero-shot navigation methods lack hierarchical spatial cognition, causing blind exploration and inaccurate semantic association.
  • HRO leverages LLMs for coarse-to-fine navigation by first identifying target room types and then locating specific objects.
In-site article

A 3DGS-Driven Dynamic Viewpoint and Vibrotactile Framework for Subsea Teleoperation Validated via fNIRS

A multimodal teleoperation architecture for ROVs using 3D Gaussian Splatting to generate occlusion-free exocentric views and a vibrotactile suit for haptic cues. A human study with 30 participants showed the exocentric view significantly improves performance under high latency, with fNIRS indicating sustained executive control rather than cognitive overload.

  • DAVS uses real-time 3D Gaussian Splatting to create an occlusion-free exocentric viewpoint
  • Vibrotactile suit maps obstacle clearance to intuitive haptic cues, reducing sensory workload
In-site article

A Bayesian framework for the uncanny valley in humanoid robot design

Researchers propose a hierarchical Bayesian generative model that operationalizes uncanny valley guidelines as mathematical design variables. The model maps the effect onto four variables: deviation from predicted robot-category mean, inconsistency in human likeness across modalities, prediction uncertainty, and observational uncertainty. Experiments show that increased observational uncertainty attenuates familiarity dips at intermediate human likeness, while low prediction uncertainty boosts ratings for robot-like appearances. This framework provides a computational basis for algorithmically evaluating and optimizing humanoid robot appearance and behavior.

  • The uncanny valley effect is translated into four manipulable mathematical variables.
  • Category ambiguity and appearance-motion mismatch reduce affinity.
In-site article

HRIBench: Benchmarking Interaction-Centric Human-Robot Collaboration

HRIBench is a diagnostic benchmark for intent-aware human-robot collaboration, using structured scenario scripts to model agent roles, temporal dependencies, and coordination constraints. It defines three interaction roles—Instructor, Collaborator, and Intruder—across 13 tasks with over 650 evaluation episodes, introducing interpretable metrics like synchronization, responsiveness, protocol compliance, and safety. Evaluations show current foundation policies struggle in collaboration, but fine-tuning on HRIBench significantly improves performance.

  • HRIBench defines three interaction roles: Instructor, Collaborator, and Intruder, covering intent communication, joint coordination, and robustness under human intervention.
  • The benchmark includes 13 role-conditioned tasks with over 650 evaluation episodes and introduces interpretable metrics such as synchronization, responsiveness, protocol compliance, and safety.
In-site article

AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow

We present AffectFlow-DINO, a multi-task learning system for the 11th ABAW challenge that extends a standard deterministic architecture with a conditional rectified-flow head to model the inherent ambiguity of in-the-wild facial behavior. The system jointly estimates continuous valence-arousal, classifies eight facial expressions, and detects twelve Action Units. Extensive ablation studies show that rectified-flow decoding consistently improves deterministic prediction, and post-hoc threshold calibration effectively recovers performance on rare classes. The final model achieves P_MTL=1.177, substantially outperforming the official baseline of 0.45.

  • AffectFlow-DINO uses a conditional rectified-flow generative distribution for uncertainty-aware one-to-many predictions.
  • The system jointly handles valence-arousal regression, facial expression classification, and Action Unit detection.
In-site article

Just-In-Time Scene Graph Growth: Combating Perceptual Saturation in Long-Horizon Robotics

This paper introduces JITOMA (Just-In-Time On-demand Memory Activation), a closed-loop framework that unifies task reasoning, perception, and memory to combat perceptual saturation in long-horizon robotics. It uses a task heatmap to filter observations and an LLM to dynamically activate relevant anchors, reducing computational overhead while maintaining stable performance. The authors also present JITOMA-Bench for evaluation.

  • Conventional 3D scene graph pipelines suffer from perceptual saturation due to exhaustive mapping.
  • JITOMA uses a task heatmap for observation filtering and LLM for on-demand anchor activation.
In-site article

Active Learning for Efficient Annotation of Surgical Videos with Weak Supervision

A human-in-the-loop framework combining active learning and dual-loss optimization reduces annotation effort for laparoscopic video segmentation by 50%. It uses a foundation model to generate temporally consistent CAMs, with weak supervision on video-level labels and image-level mask loss on human-corrected annotations from active learning. Iterative pseudo-mask refinement eliminates the need for dense initial annotations.

  • Reduces surgical video annotation effort by 50% using active learning and weak supervision.
  • Employs a foundation model to generate temporally consistent class activation maps (CAMs).
In-site article

Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?

A new study systematically compares pretrain-finetuning (PFT) and joint training (JT) paradigms for self-supervised learning, finding JT superior in data efficiency and low-label settings, while PFT is more reliable in specialized domains.

  • The study compares eight SSL methods across diverse vision tasks with varying labeled data ratios.
  • Joint training optimizes self-supervised and supervised losses simultaneously, showing robustness in low-label regimes.
In-site article

MGFace: Mask-Gated Face Matching via Conditional Similarity Routing

MGFace is a mask-gated face identification pipeline that predicts the mask status of a query face and conditionally routes similarity computation: global embedding matching for unmasked queries, and mask-aware patch-level re-ranking only for masked queries. On the extended LFW-Mask dataset, it achieves over 80% accuracy with FaceNet and over 90% with ArcFace, while reducing query time by approximately 20x compared to a prior EMD-based method.

  • Conditionally routes similarity based on predicted mask status, avoiding unnecessary fine-grained computation
  • Activates patch-level re-ranking only for masked queries, focusing on upper-face regions
In-site article

A Masked Autoencoder Approach to Unsupervised Steel Surface Defect Recognition

A Transformer-based Masked Autoencoder learns representations for unsupervised steel surface defect recognition. Pretraining masks 75% of image patches, a lightweight decoder reconstructs them, and an auxiliary defect localization objective is jointly trained. Decoder achieves SSIM 0.92, MSE 0.47, and clustering yields 91.3% Hungarian matched accuracy on six defect categories.

  • Masked autoencoder learns defect representations from unlabeled steel surface images
  • 75% of patches masked during pretraining; decoder reconstructs, encoder jointly trained with localization
In-site article

Boogu-Image-0.1: Boosting Open-Source Unified Multimodal Understanding and Generation

Boogu-Image-0.1 is an open-source family of unified multimodal understanding and generation models including Base, Turbo, Edit, and Edit-Turbo variants. It delivers competitive performance in text-to-image generation, fast inference, instruction-based editing, and bilingual text rendering. Through targeted improvements in model understanding, data quality, and training pipelines, coupled with agentic inference-time scaling, it achieves results approaching leading closed-source systems with only 208.62 million unique images and a training cost of approximately $400K.

  • Boogu-Image-0.1 is an open-source unified multimodal model family with multiple variants
  • Competitive in text-to-image generation, fast inference, instruction editing, and bilingual rendering
In-site article

A Hybrid Mamba for Audio-Visual Navigation

We propose Samba, a hybrid Mamba architecture for audio-visual navigation. It uses an adaptive selection-enabled Mamba State Encoder (M-SE) to replace conventional GRUs for temporal aggregation, and an Audio Mamba Encoder (AME) to address limitations of convolutional operators in capturing global time-frequency dependencies in spectrograms. Experiments show an 11.3% improvement in success rate on Matterport3D and even better performance on Replica, with lower computational cost. Accepted at IEEE SMC 2026.

  • Proposes Samba, a hybrid Mamba architecture with M-SE replacing GRU and AME for spectrograms
  • Improves navigation success rate by 11.3% on Matterport3D, with greater gains on Replica
In-site article

Disentangling Knowledge States with Ability and Proficiency Modeling for Knowledge Tracing

Knowledge tracing (KT) predicts student performance by modeling evolving knowledge states. Existing methods treat interactions as a unified process, ignoring phase-specific learning. We propose Phase-Aware Knowledge Tracing (PAKT), which decomposes interactions into ability and proficiency phases. A multi-branch Transformer with type-aware readout captures phase-specific and holistic states. Causal analysis reveals confounding bias in phase-agnostic models. On six benchmarks, PAKT achieves up to 1.33% AUC improvement, averaging 0.82%.

  • Current KT models overlook distinct learning phases like ability-building vs. proficiency.
  • PAKT decomposes student interactions into ability and proficiency phases.
In-site article

Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

A new framework treats the decision of when to invoke a large language model (LLM) in streaming inference as a risk-based sequential stopping problem. The authors prove six theoretical results covering minimum inter-event times, optimality of threshold policies, and regret bounds. Empirical tests on turbofan degradation data show that anomaly-score-driven risk functions outperform baseline methods by an order of magnitude in Pareto AUC.

  • Formal treatment of LLM invocation timing in streaming systems using risk-based sequential stopping.
  • Six theoretical results including regret bounds and convergence guarantees.
In-site article

Targeted Recovery of Weight-Space Mechanisms From Neural Networks

Parameter decomposition (PD) decomposes neural networks into interpretable components but is computationally expensive for large models. The proposed targeted PD (tPD) introduces a high-rank catch-all component to handle non-target data, enabling efficient recovery of circuits for specific inputs. tPD extracts a CSS-only submodel from a 4-block transformer using 7% of the FLOPs of published decomposition, and surgically ablates memorized sequences in a 12-block transformer with negligible side effects. Accepted at the Mechanistic Interpretability Workshop, ICML 2026.

  • Targeted PD (tPD) isolates components for specific inputs via a high-rank catch-all component
  • Extracts CSS-only submodel from 4-block transformer at 7% FLOPs of existing decomposition
In-site article

Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning

A new lightweight training strategy for deep learning models decouples feature extraction from classifier optimization, drastically reducing training time and energy consumption with minimal accuracy loss, as tested on multiple architectures and medical datasets.

  • Novel decoupled training strategy adapts normalization layers and precomputes features once.
  • Achieves significant reduction in training time and CO2 emissions.
In-site article

Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools

Small language models struggle with molecular property prediction due to structural blindness. A new framework called Context-Augmented Prompting integrates GNN tools to provide predictive hints and explanatory subgraphs, achieving up to 74% relative improvement on Tox21, though a gap with specialized GNNs remains.

  • SLMs miss graph-topological cues in SMILES sequences.
  • Proposed framework uses GNN expert for hints and subgraph extraction.
In-site article

Self-Improvements in Modern Agentic Systems: A Survey

This survey reviews self-improving autonomous agents transitioning from prototypes to deployed systems. It introduces a system-level framework modeling an agent as a foundation model coupled with an operational scaffold (prompts, memory, tools, control logic). Self-improvement is formalized as a self-induced update operator that updates model parameters or scaffold components. The paper categorizes prior work by update target and driving signals, and discusses applications, evaluation, and open challenges.

  • Self-improving agents are moving from research to deployment with minimal human input
  • The framework models agents as foundation models combined with an operational scaffold
In-site article

Interventional Grounding Audits: Black-Box Premise-Dependency Tests for LLM Chain-of-Thought via Predicate Substitution

Large language models produce chain-of-thought reasoning that appears logically sound but may not genuinely depend on its stated premises. This paper introduces interventional grounding audits, a black-box step-level test of premise dependency that substitutes a predicate in a single premise and checks for changes in the normalized conclusion of each reasoning step. Evaluated on ProntoQA with GPT-4o, the method achieves F1=0.806 for detecting proof-tree dependencies, significantly outperforming a self-consistency baseline (F1=0.343). Notably, 66% of correctly solved problems contain at least one step insensitive to a direct proof-tree dependency, revealing a 'right answer, wrong reasoning' signal.

  • Interventional grounding audits test premise dependency at the step level by substituting predicates in a black-box manner.
  • On ProntoQA, the method achieves F1=0.806 for proof-tree dependencies, outperforming self-consistency (F1=0.343).
In-site article

SPINE: Bridging the Cyber-Physical Gap with Agentic AI

Researchers propose SPINE, an agentic framework that automates debugging and deployment of bimanual robots, reducing reliance on expert calibration. In tests, SPINE improved success rates and reduced time-to-teleoperation compared to manual methods.

  • SPINE uses multi-agent workflows for robot profile building and iterative debugging.
  • Novices using SPINE outperformed experts on DOBOT X-Trainer, achieving 100% success.
In-site article

A better way to turn 2D designs into 3D models for rapid prototyping

Researchers developed an automated framework that helps AI models generate CAD programs more accurately and efficiently.

  • MIT and collaborators introduce GIFT, a framework that improves AI-generated CAD models by learning from model errors.
  • GIFT uses model-aware data augmentation, achieving higher accuracy with only 20% of the computation of other methods.
In-site article

xai-org/grok-build, now open source

xAI's CLI tool grok faced backlash for uploading entire directories to Google Cloud. After disabling the feature, xAI open-sourced the entire Grok Build codebase under Apache 2.0. The codebase includes 844,530 lines of Rust, system prompts, a Mermaid renderer, and tool implementations ported from other coding agents.

  • Grok CLI uploaded entire directories to xAI's Google Cloud buckets, sparking privacy concerns.
  • xAI responded by disabling the feature and open-sourcing the Grok Build codebase under Apache 2.0.
In-site article

Mira Murati’s Thinking Machines drops Inkling, an open-weights model anyone can access

Mira Murati's Thinking Machines Lab Inc. today launched its first foundation model with the release of Inkling, making its full open weights available to developers so they can fine-tune it as they wish. Inkling is a mixture-of-experts model with 975 billion parameters (41B active) trained on 45 trillion tokens of text, image, audio and video, capable of reasoning across all four modalities but outputting only text. It features "thinking effort" controls and uncertainty flagging to reduce hallucinations. The model is fine-tunable via the Tinker API and aims to provide a Western open-source alternative to Chinese AI models. Thinking Machines plans to generate revenue through the Tinker platform rather than per-token API access, potentially disrupting current AI business models.

  • Thinking Machines releases Inkling, a 975B-parameter open-weights model (41B active).
  • Trained on 45T tokens across modalities; outputs text only.
In-site article

Thinking Machines Lab Releases Inkling: A 975B-Parameter Open-Weights Multimodal MoE With 41B Active Parameters And Controllable Thinking Effort

Thinking Machines Lab released Inkling on July 15, 2026, its first model trained from scratch. The full weights ship under Apache 2.0. It is a 975B-parameter Mixture-of-Experts transformer with 41B active parameters, a 1M-token context window, and native text, image, and audio input. The core differentiator is controllable thinking effort, allowing users to adjust token budgets per call to balance cost and performance.

  • Inkling is a 975B-parameter MoE transformer with 41B active parameters, supporting a 1M-token context and multimodal input (text, image, audio).
  • Controllable thinking effort, achieved via RL, enables dynamic token budget adjustment, matching Nemotron 3 Ultra on Terminal Bench with one-third the tokens.
In-site article

NVIDIA Introduces New Jetson Thor Computers to Advance Mainstream Robotics and Edge AI

NVIDIA announces T3000 and T2000 modules based on the Thor architecture, targeting mainstream robotics and edge AI. T3000 delivers 865 FP4 teraflops at half the size and power of T5000; T2000 offers 400 FP4 teraflops. The platform scales from 70 TOPS to 2,000 teraflops. New agent skills automate memory optimization, reducing usage by up to 15GB. Cosmos 3 Edge model enables real-time vision. Emulation available now with modules shipping in Q1 2027.

  • NVIDIA introduces T3000 and T2000 Jetson Thor modules for robotics and edge AI. T3000 provides 865 FP4 TFLOPS at half the size and power of T5000; T2000 provides 400 FP4 TFLOPS.
  • New agent skills automate memory optimization across the Jetson portfolio, enabling significant memory savings.
In-site article

Agentic orchestration: Enterprise AI organizations have a deployment problem, not a platform problem — and most are calling chatbots agents

A VentureBeat Pulse Research survey of 101 enterprises reveals that agent orchestration is consolidating on model-provider platforms, with Anthropic Claude leading at 40%. However, 71% admit that a quarter or fewer of their deployed 'agents' are true multi-step workflows, and only 10% have crossed the halfway mark. Enterprises plan hybrid control planes to avoid vendor lock-in, but real-time cost control remains immature.

  • Anthropic Claude is the primary orchestration platform for 40% of enterprises, more than double any rival.
  • 71% of enterprises say a quarter or fewer of their deployed 'agents' are truly orchestrated multi-step workflows.
In-site article

Soofi Consortium Releases Soofi S 30B-A3B: An Open Hybrid Mamba-Transformer MoE Foundation Model For German And English

A German research consortium has published the pretraining report for Soofi S 30B-A3B, an open base model for German and English. It is a Mixture-of-Experts hybrid Mamba Transformer model with 31.6B total parameters, activating 3.2B per token. It achieves the highest English and German aggregate scores among tested fully open base models.

  • Soofi S 30B-A3B is a hybrid Mamba-Transformer MoE model that activates 3.2B of 31.6B parameters.
  • It leads open base models with 70.1% English aggregate and 79.1% German aggregate.
In-site article

Towards demystifying the creativity of diffusion models

Google Research reveals that the creativity of diffusion models is a mathematical consequence of 'score smoothing' during neural network training, enabling interpolation between training data points.

  • Creativity in diffusion models arises from the approximate learning of score functions due to regularization.
  • Score smoothing creates direction-dependent interpolation effects, balancing quality and novelty.
In-site article

Suno snatched millions of songs from YouTube, Genius, and Deezer

In a hacking incident, AI music generator Suno's training data was exposed, revealing it scraped millions of songs and lyrics from YouTube Music, Deezer, and Genius. This supports copyright infringement lawsuits against Suno, which admits scraping but claims fair use. Customer information was also accessed, but Suno says the breach was contained and no sensitive data was compromised.

  • Leaked data shows Suno scraped millions of songs from YouTube Music, Deezer, and Genius.
  • Suno faces multiple copyright lawsuits; it admits scraping but defends as fair use.
In-site article

RL post-training on 14 Macs across 4 countries

A research team successfully used 14 Macs spread across four countries (including a personal MacBook) for reinforcement learning post-training, achieving a held-out pass@1 improvement from 29% to 63% on PaperSearchQA. The system employs PULSE weight synchronization to compress 9GB updates to ~90MB, and an asynchronous star topology with all communication via object storage—no dedicated networking required. This is the first RL post-training run using only consumer Macs for rollout generation.

  • 14 Macs across 4 countries connected via ordinary internet completed RL post-training; rollouts generated on Macs, training on a B200.
  • PULSE compresses 9GB weight sync to ~90MB, making home internet as fast as datacenter.
In-site article

Agent runtime reduces LLM turns by 80% with a higher success rate in DeepSWE

Tura, a local open-source coding agent, reduces LLM turns by 80% and increases success rate to 80% on DeepSWE v1.1 benchmarks compared to Codex CLI High, using macro CLI commands and backward reasoning.

  • Tura achieved an 80% success rate on 20 DeepSWE v1.1 tasks, 20 percentage points higher than Codex CLI High.
  • It uses a macro tool command_run to combine multiple commands into one LLM turn, drastically reducing token usage.
In-site article

How I tricked Claude into leaking your deepest, darkest secrets

A researcher exploited a loophole in Claude's web_fetch tool to extract private user data from memories, bypassing Anthropic's protections. The attack succeeded by using nested links from a honeypot site, leading to the extraction of name, city, and employer. Anthropic fixed the issue but did not pay a bounty.

  • Claude's web_fetch tool had a loophole allowing navigation to links embedded in previously fetched pages, enabling data exfiltration.
  • Attackers created a honeypot site with sequential links that tricked the AI into leaking user memories.
In-site article

This AI Folds DNA into Mini Masterpieces

South Korean researchers developed Generative SNUPI, an AI model that uses a diffusion process to automatically design DNA sequences for origami structures, reducing the need for manual labor and expertise.

  • Generative SNUPI employs a diffusion model to convert user sketches into DNA sequences for nanofabrication.
  • The model accounts for chemical rules of DNA to ensure structural stability and self-assembly.
In-site article

Show HN: AI-CLI – tiny C terminal assistant powered by local LLM

AI-CLI is a minimal C-language command-line assistant that translates natural language requests into shell commands and executes them via a local LLM. It supports multiple LLM engines (llama.cpp, Ollama, etc.), allows user editing before execution, and includes a memory feature for complex tasks.

  • Single C file, no external dependencies beyond a local LLM server.
  • Converts natural language to shell commands; user can accept, edit, or cancel.
In-site article

GPT-Red: Unlocking Self-Improvement for Robustness

Explore GPT-Red, OpenAI’s automated red teaming system that uses self-play to improve AI safety, alignment, and prompt injection robustness.

  • GPT-Red is an automated red teaming system by OpenAI.
  • It uses self-play to generate and defend against adversarial attacks.
In-site article

Taking the Clinical Decision Out of the LLM

This article describes a system design for AI therapy that uses a deterministic pipeline to decide clinical actions, preventing the LLM from making autonomous decisions. It involves scoring, state buckets, an admission table, action selection, micro-practices, and crisis pre-screening, with the LLM only used for scoring and generation. The article also discusses the costs and limitations of this approach.

  • The system uses a fixed pipeline, using the LLM only for scoring and generation, with intermediate steps controlled by deterministic code.
  • An admission table maps nine therapeutic schools to four client states to determine allowed techniques.
In-site article

DiffRadar: Differentiable Physics-Aware Radar SLAM with Gaussian Fields

DiffRadar is a real-time radar SLAM system that models radar observations as a differentiable, physics-aware Gaussian field rather than discrete scans. It achieves substantial reductions in trajectory error on benchmarks, especially in feature-poor corridor motion, more than doubles map consistency, and maintains real-time performance at 70 FPS.

  • DiffRadar represents scenes with anisotropic Gaussian primitives and renders radar measurements via a differentiable forward model, enabling joint optimization of pose and scene structure.
  • Evaluated on the Radarize benchmark and a stress-test suite targeting common failure modes, it significantly reduces trajectory error and improves map consistency.
In-site article

Contract-Grounded Behavior Tree Synthesis via Coding Agents

This paper introduces a contract-grounded architecture for behavior tree synthesis, where a coding agent queries a robot-side MCP server to retrieve a skill library and operators, enabling non-expert users to issue natural language commands without knowing robot internals. Evaluations show near-perfect validation and high task success across 110 simulated and 14 physical tasks.

  • Proposes a contract-grounded BT synthesis architecture using a coding agent to fetch robot skill contracts via MCP.
  • Non-expert operators can issue NL commands without knowledge of robot implementation details.
In-site article

Analysis of Mutual and Referential Human and Robot Gazes in a Collaborative Word Association Game

A study investigates how robot gaze affects human visual attention in a collaborative word association game using a NAO robot. Findings show that robot gaze orientation does not influence fixation time on proposed words, but participants gaze more at the robot when seeking confirmation. The verbal aspect overshadows referential gaze in cognitively demanding tasks.

  • Examines robot gaze in task-oriented human-robot interaction.
  • Participants play word association game with NAO robot; gaze recorded.
In-site article

GaitSpan: Growing Humanoid Locomotion from Walking to Running

GaitSpan is a novel framework for growing humanoid locomotion from walking to running. It uses a pretrained walking policy as a seed skill, expanding it through rhythm generation, stride shaping, and residual adaptation, achieving continuous speed range, morphology transfer, and zero-shot deployment.

  • Treats walking as a reusable seed skill, avoiding relearning from scratch.
  • Rhythm generation modulates frozen policy with multiple internal clocks.
In-site article

Enabling 24-hour Agricultural Robotics: Unsupervised Day-to-Night Cross-Modal Image Translation for Nighttime Visual Navigation

Proposes an unsupervised image translation framework to convert daytime plant-row RGB images to near-infrared (NIR) nighttime counterparts without pixel supervision, enabling reuse of daytime semantic labels for training nighttime perception models. Leverages pre-trained CLIP model for semantic consistency and introduces a visibility mask for limited NIR illumination. Evaluated on AgriNight dataset (428 day, 549 night images) as the first benchmark for nighttime agricultural visual navigation. Real robot experiments confirm effectiveness.

  • Unsupervised day-to-night image translation framework using CLIP to preserve semantics, reusing daytime labels for nighttime.
  • Visibility mask addresses limited effective range of NIR illumination in nighttime scenes.
In-site article

EFLUX: Elastic Multi-Robot Formation Navigation and Adaptation with Agentic LLMs

Multi-robot teams in confined environments must adapt formation geometry and topology. Existing methods model deformation and reconfiguration independently or with handcrafted rules, leading to deadlock. EFLUX is a geometry-grounded LLM agentic framework that jointly reasons over deformation and reconfiguration actions via a closed-loop pipeline. Experiments show reduced deadlock and navigation failures.

  • EFLUX combines geometric scene representation with LLM reasoning for elastic multi-robot formation navigation.
  • The framework jointly handles deformation (scaling, shearing) and reconfiguration (splitting, merging) behaviors.
In-site article

Representation and Reference Selection in Training-Free Synthetic Image Attribution

A new study investigates the interplay between representation space and reference selection in training-free reference-based synthetic image attribution. Using representations from different layers of CLIP and DINOv2 along with three reference selection methods, the authors show that attribution accuracy peaks at intermediate layers and that semantically constrained references reduce query-reference mismatch, improving performance especially under limited reference budgets.

  • Attribution accuracy peaks at intermediate representation levels, indicating source-discriminative cues are more accessible before strong semantic abstraction.
  • Semantically constrained references (semantically aligned and resynthesis-based) reduce query-reference mismatch and improve attribution, especially with limited reference budgets.
In-site article

An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering

This paper presents a systematic evaluation of continual learning methods for heterogeneous medical visual question answering tasks, including classification, multi-label classification, detection, cell counting, and report generation. Findings show existing methods struggle to maintain stability-plasticity balance when tasks with different objectives are interleaved.

  • First systematic evaluation of continual learning for heterogeneous MedVQA.
  • Explored task ordering sensitivity and low-rank adaptation parameter evolution.
In-site article

Topics

Models AI News | AI News Hub