This paper resolves the open question of whether Optimistic Hedge can achieve a constant regret bound polynomial in game size. It shows the answer depends on the number of players: in two-player games, an O(n log n) horizon-independent regret bound exists, while for three or more players, no such bound is possible—some player's regret can be 2^{Ω(mn)}. The upper bound relies on a temporal approximation framework that also simplifies Ha's recent regret bound.
Thomas Fel and 25 co-authors introduce Mechanistic Shaping, a framework that uses internal representations during training to make models follow specifications about which concepts they express and rely on. Experiments across vision, medical imaging, language, scales up to 32B parameters, and training paradigms (classification, SFT, DPO, GRPO) show substantial reduction in targeted behaviors while preserving task performance. The authors further introduce a hierarchy of monitors to distinguish concepts that escape a probe from those truly gone, characterize three geometric circumvention mechanisms (drift, erasure, nonlinear encoding), and find that shaped concepts largely remain monitorable.
This paper studies reinforcement learning in partially observable Markov decision processes (POMDPs) with nonlinear neural value function approximation, proving a finite-time critic error bound for finite-memory superstate MDP surrogates and deriving finite-time sublinear regret through policy mirror descent. The authors describe it as the first finite-time sublinear regret result based on neural function approximation for finite-memory POMDPs.
This paper develops a stochastic dynamical-systems perspective on three classes of generative AI models: LLMs as high-dimensional nonlinear autoregressive models with attention-based dependencies, networks of interacting LLMs characterized by mean-field ODEs that explain emergent preferential attachment and type-dependent glass-ceiling effects, and neural SDEs for continuous-time generative modeling of stochastic trajectories, with Wiener-space cubature methods based on rough-path analysis proposed as an efficient alternative to Monte Carlo estimation.
LowRAM introduces an asymmetric KV cache compression method that exploits the predictability of values from keys within each attention head, combined with cross-layer low-rank key compression, achieving near-lossless 4x compression, up to 5x higher decode throughput, and 26.9x compression at 94.5% baseline performance when composed with quantization and eviction.
The paper introduces Time Neutralising Trees (TNT), a decision tree architecture for robust stream classification under concept drift. TNT filters out outdated training samples during training and re-includes them if they become relevant again, achieving best-in-class performance on 24 real and semi-real data streams.
A controlled benchmarking study finds that while pretraining improves time series classification accuracy over random-weight counterparts by up to 23 percentage points, frozen representations from forecasting foundation models still underperform the strongest non-pretrained baseline in 15 of 17 settings. The authors stress the need for strong task-specific baselines and random-weight controls.
This study introduces a simulation-based framework to assess the empirical calibration of posterior credible regions in Bayesian M/EEG source imaging. It compares BMN+sLORETA and SBL+S-FLEX, finding that SBL+S-FLEX yields lower localization error, tighter uncertainty, and coverage closer to nominal credibility, though both methods remain miscalibrated; isotonic recalibration improves both, and real auditory MEG data favor SBL+S-FLEX.
Octopus is a single-model multi-agent reinforcement learning framework where all threads share one backbone and coordinate over a GPU-resident DAG of KV states via five primitives. It combines zero-copy radix forking, attention-only KV mounting, and a packed DAG-GRPO trainer, achieving significant gains on BrowseComp-Plus and OpenResearcher while improving throughput and reducing KV memory.
SteelAgent couples metallurgical descriptors and machine-learning models with a language-model interface for steel property prediction, uncertainty reporting and inverse design. The study shows that the choice of held-out unit dramatically changes conclusions: gradient-boosting R² falls from 0.859 on a random split to 0.113 when steel families are held out, and coverage of nominal 90% prediction intervals drops from 91.0% to 37.6%. The effect of physics-derived features also depends on the evaluation. The authors argue for reporting the evaluation population alongside property estimates or compliance scores.
A pre-registered study tests whether self-supervised world models organize their latents around physical quantities, finding across three studies that what a latent contains and what can be controlled through it come apart.
A new paper proves that the dual objectives of support vector classification and regression are exact constrained KL divergence minimisation tasks between Gaussian measures, providing an information-theoretic interpretation for SVMs and unifying kernel methods.
The paper proposes FedSharp, a robust decentralized federated learning framework that addresses data heterogeneity, Byzantine attacks, and channel noise. By screening suspicious models, averaging the lowest-loss candidates, and applying noise-adaptive regularization, FedSharp achieves 93.5-94.9% accuracy on MNIST with 33 Byzantine nodes, far surpassing benchmarks.
A new study shows that generalist vision language models, without large-scale EEG pretraining, perform competitively with specialist EEG foundation models on clinical neurodiagnostic tasks, and adapt better in few-shot settings and with model scaling.
Researchers propose the "Confidence Score", a new kernel measure that replaces traditional alignment-to-ideal-kernel metrics. It measures alignment between an encoding of ground truth and the kernel-projected ground truth, allowing kernels that preserve intra-class structure to score highly, and shows higher correlation with classification accuracy on real and synthetic datasets.
This paper proposes Context as Covariates (CoCo), a forecasting framework where an LLM distills textual reasoning into numerically grounded forecast and confidence covariates to guide a TSFM backbone. The approach first fine-tunes the LLM via GRPO with a reward tied to forecasting improvement, then fine-tunes the TSFM on the aligned LLM's covariates. It achieves up to 12% MAE improvement over state-of-the-art TSFMs and LLM forecasters like GPT-4o on real benchmarks spanning finance, economics, weather, traffic, and security.
This paper introduces OGC-DPO, an active preference learning framework that treats each (response pair, objective) combination as a separate query, measures informativeness via the policy's implicit gradient, and selects queries that most expand each objective's gradient coverage, reducing annotation cost for multi-objective alignment. Experiments show OGC-DPO outperforms existing methods under the same annotation cost, and informative conflicts provide useful training signals.
An arXiv preprint benchmarked quantum classifiers against tuned classical models on six clinical datasets. Quantum models did not significantly outperform classical ones; finite-shot estimation was the main practical cost, not gate noise; configuration errors could reverse conclusions. The authors propose the QML-Health-READY reporting framework.
Researchers introduce the Implicit Neural Operator Solver (INOS), which pretrains a neural operator from static equilibrium solutions and embeds it within Newmark-β time integration. This enables accurate dynamic simulations without dynamic trajectory supervision, achieving over 4,600× speedup over sequential finite-element solvers in nonlinear elastodynamics and stable million-step rollouts.
The paper introduces Laplacian-Constrained Stiefel Flow Matching (LaSFM) to preserve the Laplacian nullspace constraint alongside eigenvector orthonormality and positive eigenvalues during spectral graph generation, and extends it to property-guided generation with improved spectral and graph-level metrics.
The paper proposes three general hierarchical frameworks for community detection that combine linkage-based clustering, vertex proximity matrices, and graph representation learning models. Comparing 364 module combinations on Stochastic Block Model graphs and real datasets, the best pipelines (Wasserman-Faust and mutual-information-based PPMI proximity, plus deep learning-based DNGR representations) perform competitively with Leiden and Louvain while remaining hierarchical, but time complexity limits them to networks of about 10,000 vertices on personal machines.
TensorSSM introduces an implicit neural representation for functional tensor decomposition that encodes mode-wise coordinates as coarse-to-fine spatial tokens via a K-ary rule and extends a state space model to capture cross-mode spatial dependencies, improving reconstruction accuracy and storage efficiency without strict spatial assumptions.
This paper studies first-order regret guarantees for adversarial bandits with a fixed known directed feedback graph. For strongly observable graphs, the authors bridge the gap between the minimax regret Θ̃(√(αT)) and the best existing first-order bound Õ(√((κ+1)L⋆)) by achieving an expected regret of Õ(√(αL⋆)+α), where α is the independence number and L⋆ is the cumulative loss of the best arm.
FARO introduces a function-space adaptive optimizer that treats parameter partitioning into blocks as the decision unit, assigns geometry by realized counterfactual return, and reallocates per-block budgets using equal risk contribution (ERC) from portfolio theory. On a GPT-style model, FARO-Adaptive matches the best hand-designed recipe, and FARO-ERC stably lowers clean-data loss across 6 seeds by 0.0136 nats on average without added time or memory.
This study reveals catastrophic forgetting in Walrus-1.3B during a two-stage sim-to-real adaptation: finetuning on simulated cylinder flow for just 20 epochs increases one-step errors up to 35x, and subsequent real-data adaptation further erodes simulation performance. Replaying only 1% simulated data recovers most lost simulation performance while retaining effective adaptation.
AutoHebb is a class of online-learning feedforward networks that combine meta-learning, Hebbian plasticity, and autonomous learning control to achieve zero-shot inference and continual learning, outperforming modern models and enabling reverse-engineering.
The paper introduces Certified Anchor-Based Adaptation (CABA), a candidate-agnostic post-update gate that uses held-out historical anchors on frozen representations to keep policy behavior changes within a declared budget, demonstrating a retention-plasticity trade-off in a UCI HAR proxy study.
This paper proposes LIDFS, an unsupervised feature selection method based on Local Intrinsic Dimensionality (LID). The method transposes the data matrix so that each feature is treated as a point, and estimates the LID of each feature by maximum likelihood from distances to its k nearest neighboring features. Features with lower LID exhibit greater local discriminability and receive higher importance scores. A refinement step retains one representative per feature neighborhood and demotes locally redundant features. The result is a complete ranking from which any number of features can be selected without rerunning the procedure. LIDFS does not use label or class-count information and runs in O(d²n) time. On 23 high-dimensional datasets, LIDFS ranks first in supervised evaluations and fir…
The paper identifies an "imputation bias" in the standard impute-then-detect pipeline for IIoT edge data loss and proposes the Task-Aware Diffusion Refiner (TADR), which refines imputations against a frozen downstream detector's loss, raising F1 by 0.338 on SMD and characterizing when the method helps and how fast it runs on edge hardware.
PoSE keeps the Bayesian structure of distribution system state estimation and uses a flow-matching neural network only to learn the prior distribution of substation injections, while power flow, topology and measurements enter through a noise-aware Kalman-type correction at sampling time. It improves CRPS by 6.7-7.5% on the IEEE 33-bus feeder, yields well-calibrated uncertainty, and adapts to reconfigured topologies without retraining.