Skip to content
AI News HubLIVE

Live AI News Intelligence

Live monitoring

The most important shift in AI today

105 sources in the directory · Latest publication in this list: 2026-05-22 05:20 UTC.

Live monitoring

Live updates

Trusted sources, attribution, rights, and in-site reading distilled into a signal-first AI brief.

Live updates

Reset

2026-05-22

How security teams can report cyber risk to boards

This article discusses how security teams can translate technical cyber risk into financial terms that boards understand, and introduces how Databricks Genie enables real-time, data-driven cyber risk quantification for better governance.

Databricks BlogPolicyIn-site articleHow security teams can report cyber risk to boards
FTC to Require Cox Media Group, Two Other Firms to Pay Nearly $1 Million to Settle Charges They Deceived Customers About “Active Listening” AI-Powered Marketing Service

The FTC fined Cox Media Group, MindSift, and 1010 Digital Works nearly $1 million for falsely claiming their “Active Listening” AI marketing service could listen to consumers' conversations via smart devices. The service actually resold email lists, and the FTC noted that hidden opt-ins in terms of service do not constitute valid consent.

Simon Willison's WeblogAgents / ResearchIn-site articleFTC to Require Cox Media Group, Two Other Firms to Pay Nearly $1 Million to Settle Charges They Deceived Customers About “Active Listening” AI-Powered Marketing Service
Does Slightly Mean Somewhat? Measuring Vague Intensity Words in LLM Numeric Actions

A controlled study finds that Claude Haiku compresses 10 English intensity words into 5 distinct median outputs, with the model’s interpretation heavily dependent on system state, and displays three behavioral modes near feasibility limits.

arXiv Computational LinguisticsModels / ResearchIn-site articleDoes Slightly Mean Somewhat? Measuring Vague Intensity Words in LLM Numeric Actions
When Cases Get Rare: A Retrieval Benchmark for Off-Guideline Clinical Question Answering

This paper introduces OGCaReBench, a retrieval-focused benchmark for evaluating LLMs on clinical questions beyond standard guidelines. Experiments show that even GPT-5.2 achieves only 56% accuracy, but retrieval augmentation boosts performance to 82%, highlighting the need for evidence-grounded reasoning in medicine.

arXiv Computational LinguisticsResearch / Models / StartupsIn-site articleWhen Cases Get Rare: A Retrieval Benchmark for Off-Guideline Clinical Question Answering
Reflective Prompt Tuning through Language Model Function-Calling

Reflective Prompt Tuning (RPT) is a framework that uses LLM function calling to simulate the iterative workflow of human prompt engineers. RPT employs a diagnostic function to evaluate the target model over an optimization set, summarizes recurring failure modes, and uses accumulated memory to revise prompts iteratively. Across three reasoning tasks, RPT improves over initial prompts by up to 12.9 points, remains competitive with state of the art, and improves confidence calibration.

arXiv Computational LinguisticsModels / Agents / ResearchIn-site articleReflective Prompt Tuning through Language Model Function-Calling
PromptNCE: Pointwise Mutual Information Predictions Using Only LLMs and Contrastive Estimation Prompts

This paper proposes PromptNCE, which estimates pointwise mutual information (PMI) zero-shot using only LLMs and prompts, avoiding the need for task-specific critics. It achieves Spearman correlation up to 0.82 on three datasets and demonstrates applicability in low-data educational settings.

arXiv Computational LinguisticsModels / ResearchIn-site articlePromptNCE: Pointwise Mutual Information Predictions Using Only LLMs and Contrastive Estimation Prompts
RankJudge: A Multi-Turn LLM-as-a-Judge Synthetic Benchmark Generator

RankJudge is a novel benchmark generator for evaluating LLMs as judges in multi-turn conversations. It creates paired conversations where one has a single flaw injected into one turn, enabling unambiguous labeling and precise isolation of failure categories. Implemented across machine learning, biomedicine, and finance, it evaluated 21 frontier LLM judges and ranked them via the Bradley-Terry model. The approach also uses difficulty ratings to dynamically curate evaluations, reducing label noise.

arXiv Computational LinguisticsModels / ResearchIn-site articleRankJudge: A Multi-Turn LLM-as-a-Judge Synthetic Benchmark Generator
Probabilistic Attribution For Large Language Models

This paper proposes a model-agnostic probabilistic token attribution measure that uses Bayes' rule to invert next-token log-probabilities, capturing the model's internal representation of token sequence distributions and revealing LLM behavior through entropy and attribution scores.

arXiv Computational LinguisticsModels / ResearchIn-site articleProbabilistic Attribution For Large Language Models
Sem-Detect: Semantic Level Detection of AI Generated Peer-Reviews

A new method, Sem-Detect, distinguishes human-written peer reviews from AI-generated ones by combining textual features with claim-level semantic analysis. It leverages the observation that different AI models converge on similar points while human reviewers are more diverse. On over 20,000 reviews from ICLR and NeurIPS, it improves [email protected]% FPR by 25.5% in binary setting. In three-class scenario, fewer than 3.5% of LLM-refined human reviews are misclassified as AI-generated.

arXiv Computational LinguisticsModels / ResearchIn-site articleSem-Detect: Semantic Level Detection of AI Generated Peer-Reviews
CR4T: Rewrite-Based Guardrails for Adolescent LLM Safety

A new framework called CR4T proposes rewriting unsafe or refusal-oriented LLM outputs into age-appropriate guidance for adolescents, offering a more human-centered alternative to traditional safety guardrails.

arXiv Computational LinguisticsModels / Policy / ResearchIn-site articleCR4T: Rewrite-Based Guardrails for Adolescent LLM Safety
DualOptim+: Bridging Shared and Decoupled Optimizer States for Better Machine Unlearning in Large Language Models

DualOptim+ is a novel optimization framework that introduces base and delta states to bridge shared and decoupled optimizer states adaptively, improving machine unlearning in LLMs. Experiments show superior trade-offs across forgetting, safety alignment, and multi-task learning tasks.

arXiv Machine LearningModels / Policy / ResearchIn-site articleDualOptim+: Bridging Shared and Decoupled Optimizer States for Better Machine Unlearning in Large Language Models
A Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction

This study introduces yvsoucom-iterkit, a deterministic log-driven automated machine learning framework that encodes pipeline optimization as traceable log entities, enabling analysis of component attribution, interactions, similarity, and cross-seed robustness. Experiments on the Pima Indians Diabetes and Stroke datasets with over 18,000 pipeline configurations reveal a structured and partially redundant search space, where performance is governed by a small subset of interacting components. Random Forest importance analysis identifies augmentation, model choice, and imbalance handling as key drivers on Pima, while imbalance handling dominates Stroke. Component similarity analysis shows strong redundancy. The framework achieves strong performance using ensemble models, with a lower Macro…

arXiv Machine LearningResearchIn-site articleA Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction
Harnesses for Inference-Time Alignment over Execution Trajectories

This paper studies harness engineering for LLM agents, an inference-time technique that uses task decomposition and guided execution. It reveals that more elaborate harnesses are not always better, identifying failure modes like over-decomposition, over-pruning, and hallucinated execution. Experiments show that partial harnesses, which specify only initial steps, can achieve higher pass rates than fully structured workflows.

arXiv Machine LearningModels / Agents / ResearchIn-site articleHarnesses for Inference-Time Alignment over Execution Trajectories
Predicting Performance of Symbolic and Prompt Programs with Examples

The research paper introduces a coin-flip model to predict program performance from few examples, finding that symbolic programs have all-or-nothing priors while prompt programs have diffuse priors, explaining why passing a few tests certifies symbolic but not prompt programs. RAP method retrieves similar tasks to construct proxy priors.

arXiv Machine LearningResearchIn-site articlePredicting Performance of Symbolic and Prompt Programs with Examples
HealthCraft: A Reinforcement Learning Safety Environment for Emergency Medicine

HealthCraft is a novel RL environment for evaluating LLM safety in emergency medicine, built on FHIR R4 with 24 MCP tools and a dual-layer rubric. Tests reveal that frontier models nearly fail on multi-step workflows, and infrastructure bugs can alter model rankings. The environment and tasks are open-sourced.

arXiv Machine LearningPolicy / Models / AgentsIn-site articleHealthCraft: A Reinforcement Learning Safety Environment for Emergency Medicine
Don't Collapse Your Features: Why CenterLoss Hurts OOD Detection and Multi-Scale Mahalanobis Wins

GOEN achieves 0.9483 OOD AUROC on CIFAR-10, outperforming deep ensembles and other baselines. CenterLoss is found to degrade OOD detection despite improving classification accuracy. Training takes under 20 minutes on a single GPU.

arXiv Machine LearningChips / ResearchIn-site articleDon't Collapse Your Features: Why CenterLoss Hurts OOD Detection and Multi-Scale Mahalanobis Wins
The Attribution Impossibility: No Feature Ranking Is Faithful, Stable, and Complete Under Collinearity

A new study proves that no feature ranking can be simultaneously faithful, stable, and complete when features are collinear. The impossibility is quantified for four model classes, and an ensemble averaging method called DASH is proposed as a solution. A survey of 77 public datasets shows 68% exhibit attribution instability. The framework includes practical diagnostics and implications for fairness auditing.

arXiv Machine LearningResearch / AgentsIn-site articleThe Attribution Impossibility: No Feature Ranking Is Faithful, Stable, and Complete Under Collinearity
Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation

This study explores whether language models can predict the success of research ideas before experiments. Using a dataset of 11,488 idea pairs, fine-tuned 8B models achieve 77.1% accuracy, outperforming GPT-5. RLVR further improves interpretability, demonstrating the potential of small models for autonomous scientific discovery.

arXiv Machine LearningModels / Research / StartupsIn-site articleTeaching Language Models to Forecast Research Success Through Comparative Idea Evaluation
Temporal Contrastive Transformer for Financial Crime Detection: Self-Supervised Sequence Embeddings via Predictive Contrastive Coding

Researchers propose the Temporal Contrastive Transformer (TCT), a self-supervised representation learning framework for capturing temporal dynamics in financial transaction sequences. Experiments show that TCT embeddings alone achieve AUC 0.8644, but when combined with domain-engineered features, no improvement is observed (AUC 0.9205 vs 0.9245), indicating overlap with existing features. The work suggests that self-supervised learning can reduce reliance on feature engineering, though further research is needed.

arXiv Machine LearningModels / ResearchIn-site articleTemporal Contrastive Transformer for Financial Crime Detection: Self-Supervised Sequence Embeddings via Predictive Contrastive Coding
Mahjax: A GPU-Accelerated Mahjong Simulator for Reinforcement Learning in JAX

Mahjax is a fully vectorized Riichi Mahjong environment implemented in JAX, enabling large-scale rollout parallelization on GPUs. It achieves throughputs of up to 2 million and 1 million steps per second on eight NVIDIA A100 GPUs under no-red and red rules, respectively. Designed for tabula rasa reinforcement learning, it also includes a visualization tool. Experiments show agents can effectively improve their rank against baseline policies.

arXiv AIChips / AgentsIn-site articleMahjax: A GPU-Accelerated Mahjong Simulator for Reinforcement Learning in JAX