AI News HubLIVE

Research updates

We Must Act Now – A Statement on AI's Transformation of the Economy

A group of leading economists and AI experts, including several Nobel laureates, have issued a statement urging immediate action to understand and manage the economic transformation driven by AI, which they say could be larger and faster than the Industrial Revolution, bringing both risks of job displacement and opportunities for improved living standards.

  • AI could become radically more powerful in the next decade, driving unprecedented economic change.
  • The transformation may bring large-scale job displacement but also gains in living standards.
In-site article

It's an AI web, and we're just rats in the walls

Bots now generate most web traffic, AI-generated content floods social media, and AI answers are unreliable. The web is losing accuracy and humanity.

  • Bots account for 57-58% of web traffic, humans only 42-43%.
  • Over 40% of long-form posts on LinkedIn are flagged as fully AI-generated.
In-site article

Sticker shock has execs rethinking this whole AI thing

This week on The Reg's Kettle podcast, we wonder whether tokenminning is going to bring the industry back down to Earth

  • KPMG survey: 29% of senior execs struggle with AI operational costs; nearly half reconsider deployments when costs outweigh value.
  • Vendors like Anthropic and OpenAI shift to usage-based billing, causing bill shock.
In-site article

AI as Search Engine and Printing Press Aid: Local Education Data Munging

Washington Central school district outperforms Vermont averages but Vermont itself has fallen behind national benchmarks. The district's test scores have dropped nearly a grade level since 2013, and its college continuation rate of 43.1% lags far behind the national 62%. Graduation rates remain high but raise questions about diploma meaning amid low proficiency and rising chronic absenteeism.

  • Washington Central's test scores exceed Vermont averages but have declined relative to national norms.
  • Vermont's educational standing has fallen significantly over the past decade, with declines predating the pandemic.
In-site article

Show HN: Crowdmind – open-source tool to test ideas against AI personas

Crowdmind is a local-first desktop app for fast qualitative research. It lets you create synthetic AI persona panels and test products, messages, pricing, landing pages, images, PDFs, or multi-step funnels, receiving structured feedback like scores, objections, positive signals, and recurring themes. Supports multiple LLM providers including local offline models. All data stays on your machine in a local SQLite database. Ideal for founders, product marketers, researchers, and product teams.

  • Create AI persona panels manually, from CSV, marketplace templates, or with AI generation.
  • Test stimuli with text, images, PDFs, and multi-step funnels; get scores, objections, theme analysis, and confidence indicators.
In-site article

How to Measure Video Similarity: 6 Techniques I Tested (and the One I Shipped)

The article compares six video similarity measurement techniques—GPT Vision, Gemini Flash, CLIP, perceptual hash, CV multi-metric, and Gemini Embedding 2—using a benchmark of waterfall clips. Accuracy is prioritized over speed. Gemini Embedding 2, which processes the full video, emerges as the best balance of accuracy and speed, outperforming frame-sampling methods.

  • Six video similarity techniques were tested on challenging waterfall clips.
  • Accuracy was the primary metric; speed only used as tiebreaker.
In-site article

How the most impactful AI startups will be built in emerging markets

Impactful AI startups in emerging markets are building 'small AI' solutions tailored to local conditions, such as offline clinical note-taking in Nigeria, WhatsApp-based math tutoring in Ghana, and M-Pesa integration in Kenya. The article argues that technology is not the constraint; the missing piece is an ecosystem that supports scaling from pilot to sustainable growth. The World Bank is launching a global acceleration program to support these startups.

  • Local entrepreneurs in emerging markets are creating 'small AI' tools that work offline, with limited energy and intermittent internet.
  • Examples include a Nigerian voice tool for clinical notes, a Ghanaian WhatsApp math tutor, and a Kenyan M-Pesa business insight app.
In-site article

Introducing Precursor: detecting agentic behavior with continuous client-side signals

Cloudflare launches Precursor, a client-side behavioral validation engine that continuously collects interaction signals to distinguish humans from bots across full user sessions, reducing friction for legitimate users and improving detection of advanced automation.

  • Precursor continuously captures behavioral signals (mouse movement, keyboard timing) via injected JavaScript.
  • It extends bot detection from isolated challenges to complete user sessions.
In-site article

Scientists discovered the brain doesn't make decisions the way we thought

A new study from the University of Illinois Urbana-Champaign reveals that decision-making begins earlier in the brain than previously believed, challenging the traditional hierarchical model. The researchers found that even primary sensory regions like the somatosensory cortex are influenced by higher brain areas through rapid feedback loops, suggesting a more dynamic process. These insights could inspire future AI systems that are more efficient and brain-like.

  • Decision-related activity was observed in the primary somatosensory cortex (S1), indicating early involvement in decision-making.
  • The brain uses bidirectional feedback loops instead of a one-way information flow, challenging the hierarchy model.
In-site article

Goldman Sachs warns the US will bear the brunt of AI-induced inflation surge

Goldman Sachs research shows supply constraints from the AI boom are driving up prices of key components like memory chips, boosting US core PCE inflation by about 20 basis points annually, expected to double to 50 basis points by year-end, far outpacing the average 10 basis point increase in other developed nations.

  • US core PCE inflation boosted by AI about 20 bps per year, expected to double to 50 bps by year-end.
  • AI-driven inflation comes in three waves: memory chips, software, and energy.
In-site article

Loam – AI hiring for early-stage founders

Loam is an AI-powered applicant tracking system designed for early-stage founders making their first 10 hires. It combines applicant tracking, AI candidate review, sourcing, chat, and a branded job site into one platform, with simple monthly pricing starting at free. It targets founders who are overwhelmed by spreadsheets or cannot justify enterprise ATS costs.

  • AI-native ATS for early-stage startups, replacing spreadsheets and enterprise systems
  • Features include applicant tracking, AI signals, sourcing, MCP integration, and branded job site
In-site article

Muse Spark 1.1: Meta gains 8 Intelligence Index points in three months

Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index, up 8 points from version 1.0 in just three months. Gains are concentrated in Scientific Reasoning, Coding, and Knowledge. The model is token-efficient and cost-effective, with an estimated $0.26 per Intelligence Index task.

  • Muse Spark 1.1 achieves a score of 51 on the Intelligence Index, tying with several models and trailing only Grok 4.5 and Claude Fable 5.
  • Significant improvements in coding (SciCode rank #3) and agentic knowledge work (GDPval-AA v2 Elo +232).
In-site article

Giving 'AI Slop' as Feedback Says as Much About the Commenter as the Creator

The term 'AI slop' used as criticism reveals more about the commenter than the creator. The author explores the ambiguity of the term, its lack of actionable feedback, and advises creators to reflect on their own beliefs and purpose rather than being swayed by such labels.

  • The term 'AI slop' is vague and often reflects the commenter's frustration rather than a substantive critique.
  • Such feedback provides little actionable information for the creator.
In-site article

Think for Yourself

This article examines AI's impact on writing and thinking. Through personal experience and literary references, the author emphasizes the indispensability of pauses, struggles, and inspiration in human writing, criticizing AI's attempt to eliminate these 'gaps' for efficiency, and warns that this trend may lead to atrophy of human cognition.

  • AI is eroding the natural process of pause, reflection, and inspiration in human writing.
  • Authors like Eliot, Bishop, and Dickinson illustrate that 'gaps' in writing are essential to creativity.
In-site article

'Quality decays exponentially following AI arrival': Experts leaving in droves

Research shows that generative AI like ChatGPT is driving high-quality expert contributors away from platforms like Stack Overflow, as they feel their efforts are no longer valued. This trend may spread to classrooms, offices, and research communities, causing a 'knowledge reset'.

  • Stack Overflow monthly questions dropped 76% since ChatGPT launch.
  • Expert contributors feel unrewarded as AI provides similar solutions faster.
In-site article

GenVid2Robot: From Video Generation to Robot Manipulation via Rigid-Geometric Consistency

GenVid2Robot introduces a rigid-geometric consistency framework that converts generated video motion into executable robot trajectories by tracking semantic anchors and verifying geometric consistency via a sparse SE(3) model, with a depth compensation module to reduce execution errors, enhancing reliability of video-guided manipulation.

  • Generated videos offer visual motion priors but lack metric geometry and physical executability.
  • GenVid2Robot samples semantic anchors from the real RGB-D first frame and tracks them in generated videos.
In-site article

TactiDex: A Real-World Tactile-Guided Benchmark for Human-Like Dexterous Manipulation

TactiDex is a real-world tactile-guided benchmark designed to move dexterous manipulation beyond kinematic mimicry toward contact-level human-likeness. It provides a dataset aligning whole-hand tactile signals with multi-granularity kinematic and object states, and proposes TactiSkill, a framework using a tri-component tactile reward for transferring human demonstrations to robots. Experiments show superior performance in both single and bimanual tasks.

  • TactiDex provides a comprehensive dataset and evaluation metrics aligning tactile signals with kinematic and object states.
  • TactiSkill uses a novel tri-component tactile reward to convert human demonstrations into physically plausible robot actions.
In-site article

BeyondSight: Object Permanence for End-to-End Autonomous Driving

BeyondSight is a permanence-aware end-to-end driving framework that decouples actor existence from observability by maintaining persistent actor hypotheses, enabling reasoning under occlusion. Experiments show detection mAP for unobservable actors improves from 0 to 0.249 and planning L2avg reduces from 0.61 to 0.54.

  • BeyondSight introduces object permanence to end-to-end autonomous driving to handle occluded actors.
  • It maintains persistent actor hypotheses through temporal propagation and observation-conditioned updates.
In-site article

Residual Physics-Informed Neural Networks for High-Fidelity BLDC Motor Modeling

This paper presents a Physics-Informed Neural Network (PINN) with a deep residual (ResNet) backbone that learns a continuous-time surrogate of the full six-state BLDC motor dynamics. Given simulation time, applied three-phase voltages, and excitation parameters as inputs, the network directly predicts all motor state variables -- rotor angle, angular velocity, three-phase currents, and winding temperature -- while simultaneously satisfying the governing electromechanical and thermal ODEs through a composite physics-data loss. A curriculum scheduling strategy gradually activates the physics penalty to prevent premature convergence. Training runs are completed in under two minutes on a standard CPU. Crucially, once trained, PINN inference achieves latencies of 0.1--22, mu s per query, up to 118x faster than conventional ODE solvers, making it suitable for real-time observer and control applications.

  • ResNet-based PINN for high-fidelity BLDC motor modeling
  • Directly predicts six state variables while satisfying physics ODEs
In-site article

Vascular Geometry Characterization for AI-Based Endovascular Navigation

This study identifies vascular metrics associated with navigation difficulty and develops an automated pipeline for quantitative feature extraction to enable future complexity grading. Vascular trees from 61 patients were analyzed using a Soft Actor-Critic RL algorithm for 120 s autonomous navigation. Results show that left-side bovine arch and type II/III aortic arch increase navigation time by 30.19 s and 37.92 s, respectively, while greater tortuosity prolongs procedure and reduces success. On the right side, type II/III arches extend time by 45.94 s, and each additional reverse curve adds 3.96 s. The pipeline provides a foundation for standardized complexity grading and RL model evaluation.

  • First demonstration that MT agent navigation difficulty is strongly influenced by vascular geometry.
  • Automated pipeline for quantitative characterization of vascular features developed.
In-site article

Dec-MARVEL: Decentralized Multi-Agent Exploration without Communication under Budget Constraints

This paper presents Dec-MARVEL, a decentralized budget-aware exploration framework for communication-free multi-UAV teams with directional sensing. Robots coordinate by observing teammate trajectories within their field of view. Using a graph-attention actor, they select return-feasible waypoints. Experiments show superior exploration rates and minimal sensing overlap across various team sizes and budgets, with successful sim-to-real transfer.

  • Coordination via incidental observations of teammate trajectories
  • Graph-attention network integrates local frontier geometry, teammate motion, and budget features
In-site article

CLAP: Direct VLM-to-VLA Adaptation via Language-Action Grounding

CLAP converts pretrained VLMs to VLAs by prepending language descriptions to action tokens, avoiding distribution shift. Single-epoch fine-tuning yields 90.8% on LIBERO (+14.9 over VLA-0) and improved robustness. Open-weight models at 0.8B, 2B, 4B to be released.

  • CLAP adapts VLMs to VLAs by prepending language to action tokens, avoiding output-distribution mismatch
  • Single-epoch fine-tuning achieves 90.8% on LIBERO for 2B model, +14.9 over VLA-0
In-site article

SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control

SplatCtrl is a unified framework for real-time scene reconstruction and reactive robot motion generation, enabling collision-free robotic arm control in unstructured and dynamic environments. It builds on 3D Gaussian Splatting with hybrid voxel filtering and dynamic Gaussian relocation, derives continuous signed distance functions from isotropic Gaussians, and integrates them into control barrier functions. Experiments validate its effectiveness in simulation, on physical robots, and in shared human-robot workspaces.

  • SplatCtrl combines 3D Gaussian Splatting with reactive control for collision-free manipulation.
  • Hybrid voxel filtering and dynamic Gaussian relocation support efficient scene reconstruction.
In-site article

FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Space

FlowDAgger is a sample- and compute-efficient method for adapting frozen generative robot policies from human interventions in latent space. Its key idea is action inversion, mapping each human expert action to the noise that would have produced it under the frozen base policy, then training a lightweight latent policy to steer the base model. It outperforms supervised fine-tuning and latent-space RL baselines in simulation and real-world manipulation tasks while preserving pretrained skills.

  • FlowDAgger adapts pretrained generative robot policies via human interventions in latent space, avoiding large-scale data collection or online RL.
  • Action inversion converts expert actions into noise, enabling lightweight latent policy training to guide the base model.
In-site article

AgenticFocus: Object-Preserving Mixed Reality Synthesis from Human FPV Video for Dexterous Humanoid Learning

AgenticFocus is a Mixed Reality synthesis pipeline that converts ordinary first-person-view human videos into robot-trainable demonstrations by restoring occluded object geometry, reconstructing full-hand motion, and retargeting it to a humanoid embodiment. It achieves lower trajectory error and smoother wrist motion than cross-embodiment baselines, with SPARC scores of -5.18 vs -5.56 and -6.05.

  • AgenticFocus converts ordinary first-person human videos into robot training data using Mixed Reality.
  • It handles hand-object occlusion and reconstructs full-hand motion without specialized hardware.
In-site article

Video Generation Models are General-Purpose Vision Learners

This paper presents GenCeption, a model leveraging pre-trained video generation as a backbone for general vision tasks. It achieves state-of-the-art on depth, surface normal, camera pose, segmentation, and 3D keypoint prediction, with exceptional data efficiency and emergent generalization from synthetic to real-world data.

  • GenCeption uses a video generative diffusion backbone for feed-forward perception.
  • Achieves SOTA on diverse tasks including depth, normal, pose, segmentation, and keypoints.
In-site article

C-GAP: Class-Aware and Online Prompting Improves Vision-Language Models on Imbalanced Classes

C-GAP is a novel framework that improves detection of rare object classes in vision-language models by iteratively refining language prompts using a large language model (LLM), without retraining or additional annotations. It operates in two phases: first, establishing a composite caption baseline combining scene descriptions and class-quantity context; second, an LLM iteratively refines each image's caption based on minority-class average precision (AP) thresholds. Experiments show up to 53% improvement in minority-class AP, and ~81% relative improvement on COCO.

  • C-GAP uses a two-phase approach: composite caption baseline and LLM-based iterative refinement.
  • No detector weights are updated, and no additional annotations are required.
In-site article

MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs

MultiView-Bench is a diagnostic benchmark designed to evaluate vision-language models' ability to integrate observations across multiple viewpoints into a coherent, world-centric 3D mental model. Current VLMs excel at single-view 2D tasks but struggle with 3D spatial relations and cross-view aggregation. The authors propose ViewNavigator, a multi-agent framework that actively selects informative viewpoints and fuses multi-view evidence, achieving 3-5x performance improvements on the benchmark.

  • Existing VLM benchmarks largely assess single- or limited-view perception, neglecting multi-view integration.
  • MultiView-Bench requires decoupling object positioning from transient perspectives into a global coordinate system.
In-site article

Is sub-metre resolution necessary for cocoa mapping? A landscape-stratified evaluation of very high resolution imagery, decametric Earth Observation inputs, and operational products in Cote d'Ivoire

A study in Côte d'Ivoire comparing very high resolution (0.5m) with decametric satellite imagery for cocoa mapping finds VHR achieves F1=0.92, while foundation-model embeddings like TESSERA (F1=0.86) offer scalable alternatives. Performance differences increase in fragmented landscapes.

  • VHR imagery (0.5m) achieves F1=0.92 for cocoa mapping.
  • Foundation-model embeddings (TESSERA) reach F1=0.86, outperforming Sentinel-2 (F1=0.76).
In-site article

Vision Transformers Learn Gestalt-Like Figure-Ground Cues from Natural Images

A new study shows that Vision Transformers (ViTs) can learn Gestalt-like figure-ground cues such as surroundedness, convexity, and symmetry from natural images. Testing 25 ViT models, the researchers found robust encoding of surroundedness and convexity, while symmetry cues only worked for uniformly colored regions. The work demonstrates that Gestalt cues can be learned from natural scene statistics and positions ViTs as a model system for studying perceptual organization.

  • ViTs robustly encode surroundedness and convexity figure-ground cues.
  • Symmetry cues are encoded only in uniformly colored regions, not textured ones.
In-site article

HAT Super-Resolution and a PARSeq+CLIP4STR Voting Ensemble for Extreme In-the-Wild License Plate Recognition

We describe our entry to the ICIP 2026 Grand Challenge on Extreme In-the-Wild License Plate Super-Resolution (XLPSR), which scored 9.73 wECR on the public validation leaderboard. The system pairs a Hybrid Attention Transformer super-resolution (HAT) front-end with an ensemble of two scene-text recognisers (PARSeq-S and CLIP4STR-B) and a confidence-weighted character-voting scheme that abstains on uncertain positions. Our pipeline runs in 1.7 s per sequence on RTX 3090, well under the 60 s/sequence Docker budget.

  • System achieves 9.73 wECR on ICIP 2026 XLPSR challenge validation leaderboard.
  • Combines HAT super-resolution with PARSeq and CLIP4STR recognizer ensemble.
In-site article

Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting

Lume-Palette framework achieves spatially controllable multi-view indoor scene relighting by decoupling the process into illumination distillation and illumination casting, enabling fine-grained 3D light control while maintaining multi-view consistency.

  • Proposes Lume-Palette framework that decouples relighting into illumination distillation and illumination casting stages.
  • Illumination distillation extracts canonical illumination palettes from a pretrained diffusion model to preserve material-light interactions.
In-site article

Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

This paper introduces Mixture of Probes (MoP), a framework that enables multimodal LLMs to effectively leverage auxiliary modalities only available during training. MoP uses a structured probing mechanism to extract information from intermediate representations, and MoP-X training strategy with probe disentanglement loss. Experiments show up to 65% relative improvement over baselines.

  • MoP disentangles modality-specific and modality-general signals via structured probing.
  • MoP-X training prevents probe collapse and encourages cross-modal learning.
In-site article

StereoSplat+: Feed-Forward Stereo Gaussian Splatting with Diffusion-Assisted Progressive Inference

StereoSplat+ is a diffusion-enhanced feed-forward framework that enables causal reconstruction from a single stereo pair without requiring multi-view observations. The method includes a stereo Gaussian estimator and a progressive inference scheme, improving novel-view rendering quality and geometry accuracy on the KITTI-360 dataset.

  • Introduces StereoSplat, an input-invariant feed-forward 3D Gaussian estimator handling variable numbers of stereo pairs
  • Fuses geometric cues via cost-volume and triplane branches with continuous pose encoding for cross-configuration generalization
In-site article

Letting the Data Speak: Extracting Keywords from Crowdsourced Collections with AI

This research examines the technical and ethical challenges of automated keyword extraction in crowdsourced collections, using the University of Oxford's Second World War archive as a case study. It compares three NLP approaches and finds that while promising, no method is perfect; open-weight extractive models are recommended over generative AI for responsible deployment.

  • Three NLP methods were evaluated: Named Entity Recognition, Keyword Extraction, and Topic Modelling.
  • No single method provides a complete solution; model choice heavily influences outcomes.
In-site article

Automatic Thematic Indexing of Large Literary Corpora: A Machine Learning Approach to Voltaire's Complete Works

This paper explores machine learning for automatic thematic indexing of large literary corpora, using Voltaire's works as a test case. The best model, a 4-bit quantized Mistral, achieves F1 scores up to 0.67, highlighting the potential of automated indexing.

  • Thematic indexing is crucial for scholarly access but remains labor-intensive. This study applies ML to automate it using Voltaire's 'Essai sur les mœurs' and 'Questions sur l'Encyclopédie'.
  • The task is framed as multi-label classification. Models range from encoders to fine-tuned LLMs (3–120B parameters).
In-site article

Creativity, honesty and designed forgetting emerge in small hyperbolic language models

Research shows that small hyperbolic language models can exhibit creativity, honesty, and designed forgetting, offering a small-model route to trustworthy companion AI. These models include a behavioral auditor, a creative frame-seeder, and a memory operating system.

  • Three small hyperbolic language models (146M to 3B parameters) demonstrate creativity, honesty, and designed forgetting.
  • A 146M behavioral auditor detects compliance gaps with 90.7% accuracy and identifies sycophancy, dependence-fostering, and confabulated memories in companion AIs.
In-site article

Letter Lemmatization: One-to-one and Banded RNNs for Reversing Character-Set Simplification and Abbreviation in Medieval Text

This paper introduces letter lemmatization using one-to-one RNNs with self-supervision to reverse character-set simplifications, achieving half CER recovery from just 20 text lines. It also employs Banded RNNs for abbreviation expansion in medieval charters and presents a heuristic for semantic similarity between character sets, along with a Python library.

  • One-to-one RNNs trained via self-supervision recover half the character error rate with only 20 text lines.
  • Same networks used as Banded RNNs successfully expand abbreviations in medieval charter transcriptions.
In-site article

Complexity-Guided Component-wise Initialization for Language Model Pretraining

This study analyzes weight spectra of eleven GPT-2-style pretrained models, finding shared depth trends such as increasing scale and spectral concentration in residual-writing matrices. The authors construct initialization schemes that mimic these spectral patterns, but find no performance advantage over standard methods. Pretrained weight reuse remains competitive, suggesting that coarse spectral matching is insufficient for effective reuse; richer information is needed.

  • Analyzed eleven GPT-2-style checkpoints, uncovering shared depth trends such as increasing scale and spectral concentration in residual-writing matrices.
  • Constructed initialization schemes that mimic component-wise magnitudes and spectral profiles of pretrained models, but evaluation showed no performance advantage.
In-site article

Augmenting Fundamental Analysis with Large Language Models: A RAG-Based System for Generating Investor Briefs

This study explores using GPT-4o with Retrieval-Augmented Generation (RAG) to automate fundamental analysis by processing company reports, macroeconomic data, and SEC filings. The system scanned 9 companies for 4 weeks, producing investor briefs evaluated by 9 individual investors.

  • Utilizes GPT-4o and RAG to automate analysis of company reports, macroeconomic data, and SEC filings
  • Constructs an investor knowledge base based on Kitchin cycles to aid analysis
In-site article

An Emergent Mirage: Is Emergent Misalignment and Realignment Indeed a Robust Phenomenon?

A new study questions the robustness of Emergent Misalignment (EM) in language models. While replicating EM, the authors find that misalignment and realignment are highly sensitive to superficial dataset characteristics, such as response-length differences, and previously reported representational phase transitions do not consistently correlate with behavioral misalignment. This suggests current evidence for EM is less robust than claimed, calling for more rigorous evaluation protocols.

  • The study reproduces Emergent Misalignment (EM) but finds it highly sensitive to superficial dataset characteristics.
  • Apparent rapid realignment largely disappears after controlling for response-length differences.
In-site article

HALO: Hybrid Adaptive Latent Reasoning for Language Models

HALO is a hybrid adaptive latent-refinement method that improves frozen pretrained language models by combining a coarse refinement stage with selective second-stage latent refinement based on token scoring. It achieves the best average performance on MMLU-Pro and GPQA-Diamond while using fewer compute steps than fixed baselines.

  • Combines coarse refinement with token-scoring-based selective second-stage refinement.
  • Outperforms fixed-1 and fixed-2 refinement on MMLU-Pro and GPQA-Diamond.
In-site article

Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices

A new GPU inference method for LLMs with moderate sparsity (around 50%) is proposed, using a three-layer matrix storage format that enables sparse tensor cores and CUDA cores to jointly accelerate sparse matrix multiplication. It is the first to outperform dense matrix multiplication on modern HBM-equipped GPUs, achieving up to 1.64x kernel-level speedup over SpInfer and 1.41x end-to-end speedup over FlashLLM.

  • Three-layer storage format leverages sparse tensor cores and CUDA cores.
  • First to surpass dense multiplication performance at ~50% unstructured sparsity.
In-site article

DaDaDa: A Dataset for Data Pricing in Data Marketplaces

High-quality data drives machine learning, but pricing data products is challenging due to near-zero marginal cost and unpredictable revenue. Traditional pricing methods fail; the sales comparison approach lacks benchmarks. Researchers introduce DaDaDa, the first dataset for data product pricing, containing metadata on 16,147 products from 9 major marketplaces. It enables training pricing models, establishing benchmarks, and supports classification and retrieval tasks. Experiments show effectiveness.

  • DaDaDa is the first dataset for data product pricing, covering 16,147 products from 9 marketplaces.
  • It enables training pricing models and establishing benchmarks for new data products.
In-site article

HERO: A Heterogeneity-Aware Benchmark Library for Federated Continual Learning

Federated continual learning (FCL) evaluates how distributed clients learn from changing data streams while retaining previously learned knowledge. Existing evaluations are difficult to compare because they often change datasets, task splits, client data splits, task orders, backbones, memory assumptions, and reporting rules simultaneously. We introduce HERO, a heterogeneity-aware benchmark library for FCL. HERO builds benchmark streams by separating three choices that are often coupled, namely the task split, the client data split, and the client task sequence. In HERO-Core, α controls client data skew and ρ controls task-order mismatch. We evaluate representative FCL methods on CIFAR-100 and TinyImageNet using final average accuracy, average forgetting, and bottom-10% client accuracy. Results show that method behavior changes across easy and heterogeneous settings, that average accuracy can hide weak bottom-client performance, and that the same HERO interface can expose domain-shift difficulty beyond image-based FCIL. HERO releases benchmark streams, configurations, method implementations, and reporting scripts to support reproducible and setting-aware FCL evaluation.

  • HERO decouples task split, client data split, and client task sequence to enable comparable FCL evaluations.
  • HERO-Core introduces α and ρ to control data skew and task-order mismatch.
In-site article

LieBN: Batch Normalization over Lie Groups

This paper proposes LieBN, a framework for Riemannian Batch Normalization over Lie groups, leveraging left- and right-invariant metrics for theoretical guarantees. It instantiates across nine geometries, including SPD manifold, rotation matrices, and full-rank correlation matrices, with extensive experimental validation.

  • LieBN is the first general Riemannian Batch Normalization framework for Lie groups.
  • Uses left- and right-invariant metrics for theoretical control of Riemannian mean and variance.
In-site article

Director: Accelerating Distributed MoE Serving via Online Proactive Expert Placement

Director is a new distributed MoE serving system that minimizes end-to-end latency through prediction-driven, online expert placement. It uses a lightweight cascaded predictor or low-bit quantized replica for expert activation patterns, an online migration module with near-zero downtime, and a relaxation-based optimizer that achieves a (1+ε) approximation ratio in polynomial time. Experiments show an 11–55% reduction in latency for popular MoE models.

  • Prediction-driven online expert placement
  • Near-zero downtime expert migration
In-site article

Reward Transport: Property Control in Flow Matching via Noise-Space Alignment

This paper introduces Reward Transport, which leverages optimal transport coupling to align a scalar noise-space coordinate with molecular rewards during training, enabling controllable generation at inference by simply adjusting this coordinate without requiring an oracle, reward model, gradient guidance, or additional computation. Experiments on ZINC-250K and GuacaMol demonstrate monotonic control of logP and consistent QED control, ruling out generic size bias, and the method is complementary to classifier-free guidance.

  • Proposes Reward Transport, using optimal transport coupling to align noise-space coordinates with molecular rewards for property control.
  • At training, coupling aligns a scalar coordinate with rewards; at inference, adjusting this coordinate steers generation without additional models.
In-site article

Sticky Routing: Training MoE Models for Memory-Efficient Inference

We propose StickyMoE, a differentiable routing consistency loss that penalizes abrupt expert switches between adjacent tokens during training, enabling memory-efficient inference on edge devices. Experiments show up to 60% reduction in expert switch rate with less than 4% perplexity degradation.

  • MoE models suffer from memory bottlenecks on edge devices due to frequent expert switching.
  • StickyMoE directly optimizes routing locality at training time via an auxiliary loss, requiring no architectural changes.
In-site article

Signed Symmetric Quantization for Few-Bit Integers

This paper introduces signed symmetric quantization for few-bit integers, addressing clipping errors from standard symmetric quantizers while avoiding the runtime penalty of asymmetric quantization. The method places the extra negative value on the dominant outlier tail, achieving better perplexity and accuracy on large language models at no extra inference cost.

  • Standard symmetric quantizer clips positive outliers due to signed integer alphabet imbalance, causing non-trivial error at low precision.
  • Signed symmetric quantization retains symmetric runtime benefits without asymmetric overhead by assigning the extra representable value to the dominant-outlier tail.
In-site article

Topics

Research AI News | AI News Hub