AI News HubLIVE

Live AI News Intelligence

Live monitoring

The most important shift in AI today

Distilled from 105 trusted sources. Last update 2026-05-29 04:00 UTC.

Live monitoring

Live updates

Trusted sources, attribution, rights, and in-site reading distilled into a signal-first AI brief.

Live updates

Reset
GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation

GAP3D introduces a modular diffusion-based approach that aligns VLM-generated latents directly to the patch-level feature space of a pre-trained image encoder, enabling frozen generative models to use VLMs as prompt encoders while preserving spatial structure. It trains primarily on image-text pairs, avoids large-scale 3D data, and demonstrates zero-shot multimodal capabilities, though it currently prioritizes high-level semantics over fine-grained detail.

arXiv Computer VisionModels / ResearchIn-site article
S3Mem: Structured Spatiotemporal Scene-Event Memory for Long-Horizon Interactive Question Answering

This paper proposes S3MEM, a structured scene-event memory framework for long-horizon interactive question answering. By writing trajectories into structured memory units, using anchor-sensitive retrieval, and exposing a compact token-budget-aware evidence interface, S3MEM significantly improves accuracy and efficiency in answering questions about early events. Experiments on multiple environments show that S3MEM achieves a better accuracy-efficiency frontier than existing methods.

arXiv Computational LinguisticsAgents / ResearchIn-site article
Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluation

A comprehensive evaluation of 14 open-source safety guard models on a benchmark of 79,331 samples reveals that Qwen Guard (4B parameters) achieves the highest recall (83.97%), while larger models like Llama Guard (12B) miss up to 75% of unsafe content. Model size does not correlate with safety performance, and general-purpose guard models outperform specialized ones.

arXiv Computational LinguisticsModels / Policy / ResearchIn-site article
Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning

Aryabhata 2 is a reasoning-focused language model for competitive STEM exams like JEE and NEET, fine-tuned via reinforcement learning on GPT-OSS-20B using PhysicsWallah's question banks. It achieves up to 64% fewer output tokens while outperforming the base model on multiple benchmarks.

arXiv Computational LinguisticsModels / ResearchIn-site article
Micro-Macro Retrieval: Reducing Long-Form Hallucination in Large Language Models

Large language models suffer from hallucination in long-form generation. Existing retrieval-augmented models cannot ensure key information stays close to outputs. This paper proposes Micro-Macro Retrieval (M2R), a retrieve-while-generate framework that retrieves coarse-grained evidence externally and extracts key information from a reasoning-built repository, significantly reducing hallucination. It uses curriculum learning-based reinforcement learning for stable training.

arXiv Computational LinguisticsModels / ResearchIn-site article
RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment

This paper presents RightNow-Arabic-0.5B-Turbo, a 518M-parameter Arabic-specialized LLM built on Qwen2.5-0.5B using vocabulary injection and edge-first deployment. It achieves 35.9% mean accuracy on Arabic benchmarks, outperforming all same-class open models, and ties Falcon-H1-1.5B on COPA-ar at one-third the size. The quantized model is 398 MB and delivers 635 tokens/s on a single H100, enabling efficient edge deployment.

arXiv Computational LinguisticsModels / Research / StartupsIn-site article
From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale

A new paper analyzes 17 LLMs (410M-100B+ parameters) and documents that instruction-tuned systems systematically collapse language entropy along discourse and structural dimensions (mean amplification: 1,949-16,853%, peaks: 5,181-209,675%), while suppressing complex punctuation to 3.2-23.2% of baseline. These effects do not worsen under RLHF. Weak intervention (lambda=1.0) exacerbates collapse by 240%, while strong control (lambda=5.0) achieves 40.5% improvement and outperforms frontier models by 96.7-98.2% despite 200-1000x scale disadvantage. Strong control also delivers 15% higher distinct-4, 27% higher vocabulary diversity, and 78% lower repetition than moderate regularization. The findings underscore that alignment requires sufficient control strength, not merely distributional smoothing.

arXiv Computational LinguisticsModels / ResearchIn-site article
MechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language Models

A new framework, MechELK, uses mechanistic interpretability to extract hidden knowledge from LLMs. It combines sparse autoencoders, causal probing, and representation engineering to achieve 84.7% accuracy, outperforming existing methods. The framework is particularly effective at surfacing knowledge when models give incorrect or evasive answers.

arXiv Computational LinguisticsModels / Policy / ResearchIn-site article
A Modular Architecture for Typologically Controlled Lexicon Generation

A modular framework for generating pronounceable, typologically plausible, and semantically structured artificial lexicons. It samples phoneme inventories from PHOIBLE, generates word forms under interchangeable phonological grammars (deterministic, OT, MaxEnt), and assigns meanings via Swadesh-Leipzig-Jakarta ontology. Evaluation shows probabilistic grammars outperform deterministic and random baselines in phonotactic coherence and typological realism.

arXiv Computational LinguisticsModels / Research / StartupsIn-site article
What are They Thinking? Delineation, Probing and Tracking of Concepts in LLMs

As large language models (LLMs) grow in influence, understanding their decision-making becomes crucial. This paper introduces a method to detect concepts within LLM embeddings using low-cost linear probes, enabling monitoring of what models "think" during normal operation. The authors demonstrate concept delineation, probe training, and cross-context tracking across four concepts and three LLMs, paving the way for scalable model transparency.

arXiv Computational LinguisticsModels / ResearchIn-site article
Balancing Multimodal Learning through Label Space Reshaping

Multimodal learning often suffers from modality imbalance, where faster-converging modalities dominate optimization. Existing methods typically strengthen weak modalities or adjust gradients, but may compromise strong modalities. This paper proposes Balanced Multimodal Label Reshaping (BMLR), the first label-side approach to promote balance. BMLR reshapes the cross-modal label space to equalize mapping difficulty across modalities, enhancing interaction and injecting rich inter-class information. Extensive experiments show consistent improvement and compatibility.

arXiv Machine LearningModels / ResearchIn-site article
TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models

Metagenomic taxonomic annotation identifies microbial origins of DNA fragments. Traditional similarity-based methods struggle with high diversity and incomplete databases. TaxDistill uses a knowledge distillation framework with a 500M-parameter genomic foundation model (GenomeOcean) as teacher to generate soft labels, reducing label noise. Experiments on seven CAMI2 datasets show TaxDistill outperforms baselines, e.g., improving F1 score on Gastrointestinal dataset from 0.763 to 0.941.

arXiv Machine LearningModels / ResearchIn-site article
PrismFlow: Residual Dynamics for Flow Matching in Time-Series Generation

PrismFlow introduces a novel flow matching method that uses Koopman-inspired dynamical experts to correct estimator smoothing in standard flow matching, recovering high-frequency and fine-grained temporal structures. It achieves state-of-the-art performance with 15.6% gain in Context-FID and 38.6% improvement in Discriminative Score.

arXiv Machine LearningModels / ResearchIn-site article
Self-Play Reinforcement Learning under Imperfect Information in Big 2

This paper studies self-play reinforcement learning in the four-player imperfect-information card game Big 2. PPO outperforms Monte Carlo Q approximation, SARSA, and Q-learning against various opponents. Moderate entropy regularization improves PPO by preventing overdeterministic policies, and current-policy self-play provides a stronger finite-budget curriculum than alternatives.

arXiv Machine LearningAgents / Policy / ResearchIn-site article
Molecular Lead Optimization via Agentic Tool Planning

TRACE is a trajectory-aware LLM-reasoning agent for molecular lead optimization that treats tool selection as a sequential decision-making problem, enabling forward-looking structural refinement under constraints, achieving higher success rates and property improvements on ADMET tasks.

arXiv Machine LearningModels / Agents / ResearchIn-site article
Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?

Recent work shows RL retains prior capabilities more effectively than SFT. This paper extends to the mechanistic level, introducing differential circuit vulnerability to measure circuit degradation. On Qwen2.5-3B-Instruct for scientific QA, SFT adapts faster but causes greater circuit disruption and forgetting, while RL preserves circuits at the cost of slower adaptation. Results suggest circuit preservation explains RL's robustness against catastrophic forgetting.

arXiv Machine LearningModels / Policy / ResearchIn-site article
Representation Signatures and Risk-Feedback Alignment in LLM Trading Agents

This paper studies behavioral alignment and representation dynamics of LLM agents in financial environments using TradeArena. It identifies measurable pre-failure signatures like planning embedding drift and effective-rank contraction. Structured risk feedback can serve as an external alignment signal but is not a universal performance enhancer. A 51-stock experiment reveals a correlation blind spot where LLM rationales justify concentrated exposure to coupled assets.

arXiv Machine LearningModels / Agents / ResearchIn-site article
One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them

A study reveals that knowledge editing methods like ROME and MEMIT share a common mechanism despite fact-specific weight changes. A binary mask trained over edited weights reverses over 70% of edits, indicating a shared functional subspace. The mask works by eliminating overattention in later layers, and injecting it during editing drops success from 98% to 38%. Edits suppress rather than overwrite knowledge, explaining failures to propagate changes. This work aids detection and defense against unwanted edits.

arXiv Machine LearningModels / ResearchIn-site article
VFEAgent: A Multimodal Agent Framework for End-to-End Automated Finite Element Analysis

VFEAgent is an end-to-end multi-agent system that automates finite element analysis (FEA) modeling and simulation directly from input images and problem descriptions. It combines a multimodal vision-language multi-agent pipeline with a verification-first code synthesis framework, using ReAct-driven reasoning to extract structured FEA specifications and incorporating self-debugging and fallback mechanisms for executability and physical validity. Experiments show high success rates in generating complete, physically valid simulations, outperforming LLM-based baselines in reliability and correctness, and promising to free engineers from tedious manual analysis.

arXiv AIModels / Agents / ResearchIn-site article
Frontier LLM-based agents can overcome the ontology curation bottleneck for natural phenotypes

A new study uses five frontier LLMs from Anthropic and OpenAI as 'agentic curators' in a self-contained workspace to automate phenotype annotation. The agents achieved consistency within the range of human curators and substantially outperformed traditional NLP tools, addressing the scalability bottleneck in ontology curation.

arXiv AIModels / Agents / ResearchIn-site article
Orthogonal Concept Erasure for Diffusion Models

This paper introduces Orthogonal Concept Erasure (OCE), which uses multiplicative parameter updates for precise concept removal while preserving generative capacity, supporting multi-concept erasure with high speed.

arXiv AIModels / ResearchIn-site article
Review Arcade: On the Human Alignment and Gameability of LLM Reviews

This paper empirically evaluates LLM-generated reviews for scientific papers, finding limited alignment with human reviews that varies significantly across prompts and models. It also shows that authors can game the system by iteratively revising papers based on LLM feedback, achieving statistically significant score increases for up to 35% of papers.

arXiv AIModels / Agents / ResearchIn-site article
The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

The Cognitive Categorical Transformer (CCT) is a 306M-parameter architecture that augments GPT-2 Small with cognitive and category-theoretic components, achieving 21.27 perplexity on WikiText-103, a 2.92 (12%) reduction over a fine-tuned baseline. Ablations attribute 84% of the improvement to GT-Full simplicial message passing. The study also identifies a structure/consistency distinction among categorical priors.

arXiv AIModels / ResearchIn-site article
Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction

This paper proposes behavior-aware auxiliary corrections to stabilize off-policy temporal-difference learning. By replacing the auxiliary covariance matrix with the behavior Bellman matrix, the authors introduce BA-TDC and BA-TDRC algorithms. Theoretical analysis proves fixed-point preservation and almost-sure convergence. Experiments on standard benchmarks show that the behavior-aware replacement improves performance, but regularization is needed for robust results.

arXiv AIModels / Policy / ResearchIn-site article
Behavior-Induced Mirror-Prox Temporal-Difference Learning for Faster Off-Policy Prediction

This paper proposes STHTD-MP, a behavior-induced Mirror-Prox temporal-difference method that replaces the covariance metric with the symmetric part of the behavior-policy Bellman matrix to improve off-policy prediction speed. Theoretical convergence analysis and numerical experiments on several benchmarks show improved performance over GTD2-MP.

arXiv AIModels / Policy / ResearchIn-site article
Ruby inventor Matz working on native compiler with AI help

Yukihiro Matsumoto, creator of Ruby, is building Spinel, an experimental ahead-of-time compiler for Ruby with AI assistance from Anthropic's Claude. Spinel compiles Ruby to C code, achieving significant performance gains but with many limitations including unsupported features like eval and threads.

Hacker News AIAgents / ResearchIn-site article
Disposable Software – How to Stop Worrying and Love the AI Code

The article explores the concept of 'disposable software' in the AI era, arguing that AI-generated code should be treated as disposable to accelerate development, much like mass-produced furniture replaced artisan craftsmanship. A case study demonstrates successful AI refactoring, and a 'Disposable Code Manifesto' is proposed with three pillars: intent, requirements, and safety.

Hacker News AIPolicy / ResearchIn-site article
Strengthening societal resilience with Rosalind Biodefense

OpenAI launches Rosalind Biodefense, expanding trusted access to GPT-Rosalind for vetted developers and U.S. government partners advancing biodefense, public health, and pandemic preparedness through frontier AI.

OpenAI NewsModelsIn-site article