A study using sparse autoencoder features from GraphCast finds that causal relevance does not require conventional physical semantics: ablating a mesh-locked feature increases global geopotential height error, while amplifying convection-related features cuts tropical-cyclone intensity error by a median of 51% across seven storms.
The discoCVI R package version 0.2.0 computes the DISCO index exactly using single-linkage merge trees, reducing memory to linear and achieving 23-138x speedups, scoring 100,000 points in ~50 seconds with <200 MB.
Researchers introduce a video-based presentation attack detection dataset of 374,000+ frames from 261 identities across five standoff distances (1–100 m) under indoor/outdoor conditions, using DSLR and mobile sensors with three-class labels: live, spoof, and props. Benchmarks show DSLR maintains near-perfect spoof detection at all distances, while mobile sensor performance degrades sharply beyond 50 m; EfficientNet achieves 98.48% accuracy.
HapBO introduces a method that compiles natural language beliefs from experts or LLMs once into a reusable belief function, applied in Bayesian optimization via a bounded positive multiplier without in-loop LLM calls. Theoretical analysis shows that under Expected Improvement, HapBO preserves the standard simple-regret rate up to a bounded factor even with adversarial beliefs. Evaluated on 40 HPOBench tasks, a synthetic suite, and two real-world applications (cortical neurostimulation and constrained solar design), HapBO achieves the lowest aggregate HPOBench regret and strong real-world performance with zero in-loop token cost.
Researchers construct a sample compression scheme of size O(d^2 log^2 d) for every binary concept class of VC dimension d, proving the weaker Floyd–Warmuth sample compression conjecture; only exponential bounds were previously known.
A study on the APT dataset systematically analyzes how four feature reduction techniques—PCA, permutation importance ranking, recursive feature elimination, and univariate mutual information—affect the adversarial robustness of SVM, decision tree, random forest, multi-layer perceptron, and k-nearest neighbors models under poisoning, backdoor, and universal adversarial perturbation attacks. Permutation importance ranking and univariate mutual information generally provide the most consistent robustness improvements, while other methods show variable effects depending on classifier and attack scenario.
The paper introduces PoolDPP, which formalizes diverse generation as sampling a size-K subset of complete strings from a determinantal point process (DPP) and approximates it via a finite candidate pool, with a theoretical KL bound decaying as O(1/N). Experiments show improved quality-diversity and precision-recall frontiers on open-ended generation, text-to-SQL, and math reasoning.
This paper proposes Density Feedback Control (DFC), which dynamically adjusts the sparsity coefficient at the end of each epoch based on the gap between observed hard-mask density and target density, enabling generative sparse adversarial attacks to achieve target density in a single run and improving transfer attack success rates on CNN and Transformer models.
The paper shows that interference in model merging can be predicted by a first-order directional derivative of task A's outputs along task B's vector, but only when evaluated at the receiver model. Based on this, LR-Merge, a label-free correction method, significantly improves various base mergers with high computational efficiency.
The paper introduces PsyWorld, a profile-conditioned state world model that uses observed environment-behavior state transitions as structured supervision for behavioral prediction instead of treating personality as a direct action descriptor. On the VEET simulator it reaches 0.904 Top-1 accuracy on unseen participants and was accepted to the KDD 2027 AI for Sciences Track.
This paper proposes a confidence-based framework for materials data quality assessment that integrates domain knowledge with graph-structured learning, formulating quality as continuous confidence estimation and demonstrating significant improvements in model performance through rule calibration and graph refinement on multiple benchmarks.
An arXiv paper argues that general-purpose LLM serving engines such as vLLM waste effort on generative recommendation inference, where beams redundantly re-read the shared prompt KV cache and each beam-search step is a separate engine invocation. Using Tree Attention plus compiler- and scheduling-level optimizations, the authors cut end-to-end latency by up to 25x over vLLM on Ascend NPUs without custom kernels, matching a state-of-the-art custom-kernel solution.
A study on a 58-person dataset evaluated several machine learning algorithms for Parkinson's disease diagnosis, finding decision tree and logistic regression most accurate (72-76%), all models achieving high sensitivity (up to 97.56%) for positive cases, but poor performance in distinguishing healthy controls.
This paper studies the choice of a proper loss when the threshold distribution belongs to a finite specified family. Under integrable loss weights with a positive pointwise floor and fixed total mass, the authors derive the weight that minimizes the sharp, distribution-free multiplier from surrogate regret to threshold-averaged decision regret. The solution clips a rescaled upper envelope of the threshold densities at the prescribed floor, with normalization found by a one-dimensional root search. Proofs of sharpness, optimality, and stability under density misspecification are given, along with a limitation for atomic threshold laws. An exact histogram implementation and synthetic experiments verify the construction.
This paper proposes Chebyshev polynomial zonotope abstractions to replace Taylor expansions for certified reachability of learning-enabled nonlinear systems. The authors prove that Taylor expansions have a set-width cap due to complex-plane singularities, while Chebyshev abstractions have no such cap and gain width geometrically with degree. Experiments on closed-loop control and MNIST classifiers show certificates survive where Taylor ones diverge, flipping specifications from unknown to proven.
A new arXiv paper defines training-state equivalence via intervention response and finds that fifteen descriptors, despite carrying predictive information beyond weight norm and loss, show a 16.1% advantage that cannot be separated from a conditional placebo, suggesting decodable information need not form the pairwise geometry required for similarity judgments.
A new paper analyzes the seven-vertex counterexample to Goemans's unsplittable-flow conjecture found by Dmitry Rybin via ChatGPT, and develops a forward construction pipeline that characterizes all counterexamples for a given topology. The pipeline, based on adding shortcut arcs to an arborescence and using a conflict polytope, is shown to be transferable: ChatGPT produced counterexamples on 93 other arborescence shapes, explaining why the original example was hard to find by blind enumeration.
A new preprint combines several biologically motivated spike-encoding schemes with Rouser adaptive-threshold surrogate gradients and K-FAC second-order optimization, showing on MNIST and Fashion-MNIST that these methods can improve spiking neural network accuracy and parameter efficiency without increasing model size.
GridForge is an open-source physics-informed digital twin and benchmark suite released on arXiv for fault diagnosis and prediction in UK 11 kV underground distribution cables, combining IEC-standard thermal models, a calibrated synthetic dataset of 64 cables (320 cable-years), a PINN surrogate with 0.148 °C RMSE on a held-out set, and a five-task benchmark with three reference baselines; only the virtual-sensor task currently discriminates between baselines.
This arXiv review traces the development of Prandtl neural networks, Preisach neural networks, generalized Prandtl neural networks, the neuro-Madelung model, extended Preisach neural networks, and dynamic plastic continuous neural networks, focusing on how their architectures, activation functions, and training algorithms encode hysteresis memory, degradation, non-congruency, asymmetry, and rate dependence.
This study proposes a self-supervised urban representation learning framework that uses over 1.8 million georeferenced crime records from Mexico City to construct hourly, weekly, and static reporting profiles, learn scale-specific representations, and integrate them into a unified latent space. Neighbor Profile Divergence (NPD) then quantifies disagreement between each region's reporting profile and those of its retrieved peers to identify unusual reporting patterns. Experiments show a mean Silhouette score of 0.4052 versus 0.2863 for Hex2Vec, with NPD rankings highly stable across neighborhood sizes (Spearman correlations 0.9720–0.9951). High-divergence regions exhibit spatially organized patterns and serve as an internal auditing and prioritization mechanism rather than direct evidence…
Regularized Score Centering (RSC) adds a reverse KL penalty to score centering to keep the learner close to the behavior policy in asynchronous RL. Theoretical analysis shows improved convergence, and experiments on math reasoning and six agentic tasks show substantial sample efficiency gains, with 14.3% improvement on AppWorld and 9.9x the strongest baseline on BabyAI.
The ocean absorbs nearly 30% of anthropogenic CO₂ emissions, but sparse observations make estimating surface-ocean CO₂ challenging. Most existing ML estimates are deterministic, with uncertainty approximated post hoc. This paper uses Treeffuser, a conditional diffusion model with gradient-boosted-tree score functions, to learn the full predictive distribution of ΔpCO₂ from 13 environmental, spatial, and temporal predictors. On a held-out SOCAT test set, Treeffuser achieves the lowest continuous ranked probability score (8.229 μatm) and coverage closest to nominal 68%/95% levels (0.686/0.930), while retaining point-prediction skill comparable to a deterministic XGBoost baseline (RMSE 18.4 vs. 17.7 μatm; R² 0.77 vs. 0.79). Results show conditional diffusion can provide well-calibrated, obse…
This paper provides a theoretical foundation for LLM alignment methods by modeling pairwise preference methods as vector fields on the probability simplex. Closed-form margin ODE solutions reveal unbounded DPO margins, finite IPO margins, a label-noise phase transition in DPO, and gradient concentration effects on trainability. The theory guides method design, yielding TPO-S, a label-smoothed SimPO variant validated across three 8B-9B models.
This paper studies quantum minimum finding for layer-group learning-rate selection in a hybrid classical-quantum training framework, comparing fixed-budget and confidence-based stopping policies and introducing an Interaction-Guided Schedule Oracle that scores joint schedules in superposition without a precomputed score table. In closed-loop fine-tuning of a 1.5-billion-parameter language model, each selected schedule drives 200 classical steps and benchmark accuracies fall within the range seen across five uniform-rate seeds.
The paper proposes FACE, a flow-matching-based channel estimation framework for mmWave MIMO. FACE exploits angular-domain sparsity and uses a learned flow model as a generative channel prior, outperforming conventional and diffusion-based estimators while requiring fewer pilots, fewer sampling steps, and lower inference cost.
An arXiv paper shows that the rate-related effect of layerwise learning-rate strategies can be summarized by an effective learning rate computed directly from the multiplier profile. Test-accuracy changes closely track training-loss changes (r = -0.996), and a parameter-weighted power mean with exponent around 0.35 explains more within-architecture variance than the arithmetic mean. Ranking candidates by this scalar without training improves the selected candidate's mean percentile rank from 26th to 10th and cuts its accuracy shortfall from 3.70 to 1.12 points. The effect decays as training budgets grow.
Researchers propose TIBECG, an architectural temporal information bottleneck that reduces leakage of demographic information such as age and sex when releasing individual ECG leads. Across 6,386 recordings, 12 leads, and 21 latent lengths, the method retained at least 95% of clean macro-F1 while reducing age/sex interval gain by a median 22.08 percentage points versus the best eligible conventional transformation. Direct downsampling usually suppresses demographic inference more strongly but at a larger diagnostic utility loss; TIBECG favors utility preservation. The findings support lead-specific evaluation rather than validated consumer deployment or expert-readable reconstruction.
AdaFlowLite introduces opportunistic inference for asynchronous multi-modal mobile data, using a hierarchical normalized matrix to model cross-modality affinity and a multi-modal lightweight Swin Transformer for real-time data imputation, achieving significant reductions in latency and energy consumption while improving accuracy.
DeltaHarness is an execution-guided policy-search method that adapts agent harnesses from cold-start measurements, using a QHI loop to update runtime dispatch and revise plans, significantly reducing latency in tasks like video editing.