Skip to content
AI News HubLIVE

Live AI News Intelligence

Live monitoring

The most important shift in AI today

105 sources in the directory · Latest publication in this list: 2026-06-01 04:00 UTC.

Live monitoring

Live updates

Trusted sources, attribution, rights, and in-site reading distilled into a signal-first AI brief.

Live updates

Reset

2026-06-01

Cross-Lingual Steering for Figurative Language Generation

This study investigates whether internal signals for figurative language generation in multilingual LLMs are language-specific or cross-lingually reusable. Using activation steering, the authors estimate a direction from figurative-literal activation differences in one language and apply it to generation. Across five figurative categories, six languages, and four LLMs, these directions steer reliably within the same language, especially for metaphor and simile. More importantly, they transfer across languages: a direction learned in one language increases the target behavior in another, with German being most receptive. Combinations of directions from multiple languages can match or exceed native directions, while removing shared components weakens steering. These findings provide direct…

arXiv Computational LinguisticsModels / ResearchIn-site articleCross-Lingual Steering for Figurative Language Generation
Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology

A new study uses historical cosmology as a controlled experiment to investigate how domain adaptation reshapes explanatory behavior in language models. Phase 1 trains a small model from scratch on a pre-Copernican corpus; Phase 2 fine-tunes a larger model with QLoRA. Results show domain adaptation primarily shifts explanatory framing (premodern vs modern) rather than directly altering cosmological stance, suggesting stance changes are secondary to framework shifts.

arXiv Computational LinguisticsModels / ResearchIn-site articleDomain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology
Exploring Autonomous Agentic Data Engineering for Model Specialization

Large Language Models (LLMs) struggle to adapt to specialized domains without high-quality domain-specific data. This paper introduces Autonomous Agentic Data Engineering, where LLMs act as autonomous data engineers to plan, generate, and iteratively optimize training data. GPT-5.2 achieved a 57.29% improvement in a student model through agent-driven data adaptation.

arXiv Computational LinguisticsAgents / Models / ResearchIn-site articleExploring Autonomous Agentic Data Engineering for Model Specialization
Protocol for evaluating ChatGPT in biomedical association generation and verification using a RAG-enabled, cross-model majority voting workflow

We present a protocol to evaluate ChatGPT's ability to generate disease-centric biomedical associations. It outlines how we generate the associations, validate the biological entities using biomedical ontologies, and verify associations using literature. The protocol includes a self-consistency strategy to assess generative reliability across ChatGPT models. To address ontology exact-match limitations, we provide a use case performing semantic verification through a workflow enabled by Retrieval-Augmented Generation (RAG) powered by open-source large language models (LLMs). This enables LLMs to establish truth over content generated by other LLMs and expose hallucination.

arXiv Computational LinguisticsAgents / Models / ResearchIn-site articleProtocol for evaluating ChatGPT in biomedical association generation and verification using a RAG-enabled, cross-model majority voting workflow
Calibrated Preference Learning: The Case of Label Ranking

This paper formalizes calibration for probabilistic label ranking, developing a hierarchy of notions covering full, sub-, and top-k rankings. It proves full-rank calibration implies others but not conversely. Empirical results show popular label ranking models are poorly calibrated, and calibration correlates with RLHF reward model accuracy beyond top-1.

arXiv Machine LearningResearchIn-site articleCalibrated Preference Learning: The Case of Label Ranking
LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis

Existing benchmarks mostly evaluate isolated or short interactive tasks, failing to test agents' ability to track evolving analytical context over long horizons. Researchers introduce LongDS, a benchmark with 68 tasks from real Kaggle notebooks spanning 2,225 turns across six domains. Evaluation shows best model achieves only 48.45% average accuracy, performance drops 47 points from early to late turns, and long-horizon errors account for 52%-69% of failures. Additional steps don't necessarily improve performance; key bottleneck is maintaining correct analytical state.

arXiv Machine LearningAgents / ResearchIn-site articleLongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis
NumLeak: Public Numeric Benchmarks as Latent Labels in Foundation Models

NumLeak is a measurement framework to detect memorization of public numeric benchmarks in foundation models. Top LLMs recall exact values with high Pearson r (0.97-0.99) on financial and economic data, but performance collapses on recent holdouts. White-box logprob ranking detects memorization better than open-ended generation, and a simple system prompt defense blocks 99.8% of suffix attacks.

arXiv Machine LearningModels / Research / StartupsIn-site articleNumLeak: Public Numeric Benchmarks as Latent Labels in Foundation Models
A Novel Evaluation Metric for Unsupervised Learning in AIS-Based Maritime Anomaly Detection: MADQI

This paper introduces the Maritime Anomaly Detection Quality Index (MADQI), a novel composite metric for evaluating unsupervised anomaly detection models on AIS data without labeled data. It integrates four metrics: ARC, PPS, SDS, and ECE, normalized via multi-chunk evaluation and adaptive scaling. Experiments achieved an MADQI score of 80.37%, with ECE and ARC scores of 0.907 and 1.000, demonstrating effectiveness in detecting extreme anomalies and maintaining consistency.

arXiv Machine LearningResearch / StartupsIn-site articleA Novel Evaluation Metric for Unsupervised Learning in AIS-Based Maritime Anomaly Detection: MADQI
Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification

A new fMRI generative framework called Dual-Spectral Flow Matching (DSFM) is proposed, cascading discrete wavelet transform and discrete cosine transform to capture multi-scale transients and low-frequency energy compaction of BOLD signals. Class-conditioned cosine-frequency representations are generated via spectral flow matching, then reconstructed into physiologically plausible time series via inverse transforms, improving downstream brain network classification. Accepted at ICLR 2026; code open-sourced.

arXiv Machine LearningResearchIn-site articleFunctional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification
LLMs Without Deep Neural Networks: New Architecture, Benefits and Case Study

This paper introduces a novel LLM architecture based on RBF networks that eliminates deep neural networks, finds the global optimum of the loss function in closed form in one iteration, and offers improved explainability and accuracy.

arXiv Machine LearningModels / ResearchIn-site articleLLMs Without Deep Neural Networks: New Architecture, Benefits and Case Study
When LLMs Learn to Be Consistently Wrong: A Multi-Model Study of Linear Representations of Synthetic Deception

This study introduces a multi-model paradigm to study synthetic deception via LoRA fine-tuning of five transformer models. Linear probes detect deception with near-perfect AUC in early layers, and logistic regression probes outperform MLP probes, supporting the Linear Representation Hypothesis. Probes generalize across domains with minimal loss. Different models exhibit distinct representational regimes: collapse in Pythia/Llama/Qwen versus high-dimensional preservation in Gemma-2. The results show that robust, domain-invariant deception representations can be rapidly entrenched through modest supervised fine-tuning, with implications for activation-based monitoring.

arXiv Machine LearningModels / Policy / ResearchIn-site articleWhen LLMs Learn to Be Consistently Wrong: A Multi-Model Study of Linear Representations of Synthetic Deception
Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling

The Unicorn framework uses a latent prototype codebook to decouple correlation modeling from channel identities, enabling scalable pretraining across heterogeneous datasets and outperforming existing methods in few-shot transfer scenarios.

arXiv Machine LearningModels / ResearchIn-site articleUnicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling
Gait2Hip-60: A Unified Deep Learning Benchmark for Predicting Hip Muscle Forces and Joint Moments from Multi-Cadence Gait Kinematics

Researchers developed a deep learning framework to predict hip dynamics from gait kinematics, comparing LSTM, Transformer, and Mamba. Transformer performed best on 60 healthy subjects and retained moderate predictive ability on osteonecrosis patients in zero-shot testing. The study demonstrates feasibility but calls for broader validation.

arXiv Machine LearningResearch / ModelsIn-site articleGait2Hip-60: A Unified Deep Learning Benchmark for Predicting Hip Muscle Forces and Joint Moments from Multi-Cadence Gait Kinematics
QASM-Eval: A Dataset to Train and Evaluate LLMs on OpenQASM-3 Beyond Quantum Circuits

Quantum computing in the NISQ era requires hardware-level capabilities such as mid-circuit measurement, classical feedback, precise timing, and pulse-level access, all exposed by OpenQASM-3. However, no dataset existed to train LLMs on these hardware-oriented features. QASM-Eval fills this gap with an expert-verified test set of 100 tasks and a training set of 4,000 tasks covering classical logic, timing scheduling, pulse control, and complex workflows. An extended verifier automatically checks syntax, quantum states, and timeline. Evaluation shows that state-of-the-art LLMs struggle significantly on OpenQASM-3 tasks, but fine-tuning on QASM-Eval yields substantial improvements, providing a crucial benchmark for developing reliable LLM assistants in quantum programming.

arXiv Machine LearningModels / Research / AgentsIn-site articleQASM-Eval: A Dataset to Train and Evaluate LLMs on OpenQASM-3 Beyond Quantum Circuits
MAVEN: Improving Generalization in Agentic Tool Calling

MAVEN (Modular Agentic Verification and Execution Network) is a lightweight symbolic reasoning scaffold designed to enhance generalization in tool-calling environments through structured decomposition, adaptive tool orchestration, and intermediate verification. On the MAVEN-Bench stress test, MAVEN improves the GPT-OSS-120b base model from 48% to 71% accuracy without additional training, using an open-weight backbone at roughly 1/10 the cost of proprietary baselines.

arXiv AIAgents / Models / ResearchIn-site articleMAVEN: Improving Generalization in Agentic Tool Calling
Healthcare Mechanisms from Policy-as-Code Search under Strategic Provider Response

Existing healthcare AI benchmarks fix provider responses, failing to evaluate mechanisms by their resulting equilibrium. This research recasts hospital mechanism design as program synthesis for language models, using a multi-agent simulator (Medi-Sim) and LLM-guided evolutionary code search to synthesize an inspectable mixed-objective program that eliminates up-coding, halves rejection, and retains most baseline funds.

arXiv AIModels / AgentsIn-site articleHealthcare Mechanisms from Policy-as-Code Search under Strategic Provider Response
Structure-Induced Information for Rerooting Levin Tree Search

A new paper proposes three rerooter designs to enhance subgoal-based policy tree search by using implicit subtask decomposition via the sqrt(LTS) algorithm, achieving state-of-the-art online training efficiency without explicit subgoal generation.

arXiv AIResearch / AgentsIn-site articleStructure-Induced Information for Rerooting Levin Tree Search
EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMs

EHRBench is an automated and reliable benchmark that leverages electronic health records (EHR) through an EHR-LLM-KB pipeline to generate nearly 1 million QA items covering diagnosis, treatment, and prognosis tasks. It evaluated over 30 LLMs, revealing consistent performance trends and highlighting gaps toward clinically reliable systems. The work has been accepted at KDD 2026.

arXiv AIModels / Research / AgentsIn-site articleEHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMs
Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents

LLM agents adapt by updating external harnesses (prompts, skills, memories, tools), but it's unclear if base task-solving ability predicts harness self-evolution capability. The study shows harness-updating is flat across models, while harness-benefit is non-monotonic: mid-tier models benefit most, with weak and strong tiers benefiting less. Recommendations include investing in the task-solving agent over the evolver and focusing on harness invocation and long-horizon instruction following.

arXiv AIModels / Agents / ResearchIn-site articleHarness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
Procedural Generation of First Person Shooter Maps using Map-Elites

A paper on arXiv explores using MAP-Elites, a quality diversity algorithm, to procedurally generate First-Person Shooter (FPS) maps. The authors introduce two novel map representations (Point-Line and Spatial-Layout) and define metrics for topological and emergent properties. Using MAP-Elites with Sliding Boundaries (MESB) to evolve maps, results show new representations yield higher diversity and quality than previous methods.

arXiv AIResearchIn-site articleProcedural Generation of First Person Shooter Maps using Map-Elites
PhyDrawGen: Physically Grounded Diagram Generation from Natural Language

PhyDrawGen is a neuro-symbolic pipeline that generates physically accurate diagrams from text. It uses an LLM to extract a scene graph, a deterministic solver to encode physics constraints, and a fine-tuned Qwen-VL model to iteratively correct violations. Evaluated on 1,449 problems, it outperforms GPT-5-image and Gemini models.

arXiv AIModels / ResearchIn-site articlePhyDrawGen: Physically Grounded Diagram Generation from Natural Language