A new study introduces a computational text-analytic framework that uses 54,670 Ottoman Turkish court records from 1513 to 1911 to quantify cultural dimensions such as individualism, collectivism, and honor, releasing adapted models, a scoring pipeline, and an interactive web interface.
CANDID is an execution-control framework that improves the reliability of local computer-use agents (CUAs) in resource-constrained settings. Instead of textual reflection, it repurposes parallel test-time scaling into disciplined, execution-level intervention at sparse failure-prone points, adding a loop-recovery mechanism and a unanimous DONE gating policy. On OSWorld, it significantly improves success rates over feedback-based alternatives with minimal overhead.
Researchers present No-Harm-Jury, a framework that uses five diverse language models as independent jurors to score AI-generated medical responses across seven harm dimensions. Applied to 2,849 valid responses from Ministral-14B on PubMedQA, MedQA, and MedMCQA, the framework employs median aggregation to suppress individual juror biases.
This EACL 27 main-conference paper studies prompt construction for in-context learning under a fixed token budget, finding that spending the budget on more short demonstrations is generally more effective than using a few long ones for question answering, across six instruction-tuned LLMs and two QA benchmarks.
Researchers introduce HireWatch, a benchmark that tests whether large language models comply with U.S. federal laws governing interview questions. Across roughly 100,000 trials with 18 models, compliance proved brittle: models mostly avoid unlawful questions under low pressure, but violations rise sharply as contextual pressure increases, and explicit legal-compliance prompts help without eliminating violations.
Researchers introduce PRKV, a training-free KV cache eviction method that runs Personalized PageRank over attention-induced transition graphs to estimate multi-hop global token importance, letting importance propagate beyond recency or instantaneous attention. Benchmarks on long-context understanding, sparse retrieval, and chain-of-thought reasoning show competitive performance against established eviction baselines even at compression ratios up to 90%, while cutting peak memory with low end-to-end overhead.
Zeyuan Allen-Zhu runs 64 from-scratch pretrainings (1.3–8B parameters, 1–2T Nemotron-CC tokens, roughly $100k per 8B run) to ask whether standard benchmarks capture architecturally meaningful differences. At academic scale (1.3B/100B) differences nearly vanish under careful tuning, but at 1–2T tokens Canon layers consistently improve Transformers and save about 30% of pretraining tokens at 8B for the same MMLU accuracy. New GLA5 and GDN2 variants improve gated linear attention and Gated DeltaNet with low-rank output gates; with Canon, plain gated linear attention matches Gated DeltaNet and beats Mamba2 even at 8B/1T. Yet even at that scale, linear models that match Transformers on benchmarks fail to reliably retrieve from a 500-token context, and no model beats random guessing on the simp…
TETHER is a training-free framework that elevates the table of contents (ToC) from discarded noise to a vital structural prior for hierarchy recovery in long, design-driven documents. Using a two-stage neuro-symbolic mechanism—LMM-based skeleton construction with spatio-semantic constraints followed by anchor-based alignment of content blocks—it achieves state-of-the-art zero-shot hierarchy recovery on multilingual ESG reports, product manuals, and annual reports, while cutting tokens by 90% and drastically speeding up over end-to-end baselines.
ICARE is a novel framework that combines a representation-learning-based instance selection module with feature- and logit-level knowledge distillation to mitigate catastrophic forgetting in continual multi-task natural language inference, achieving significant improvements in target accuracy and reductions in forgetting on benchmark text classification datasets.
The paper disproves the analogy between LLM token count and classical time complexity, introduces LLM Complexity—a metric based on the area under the accuracy-token curve—and shows it yields consistent task difficulty rankings across models, enabling an easy-to-hard curriculum that improves fine-tuning accuracy while reducing token usage.
The paper argues that ranking, selective prediction, and correction utility are separate claims about a confidence signal, derives a pre-experiment bound on when gated correction can be detected, and shows empirically that many reported gains are capped by measurement resolution rather than signal quality.
This paper reframes sycophancy as "inappropriate agreement" and introduces SycoDrift, an evaluation set of 3,298 validity-annotated probes. It analyzes three pressure sources: human preference data, automated judge specification, and in-context personalization. Findings show weak and mostly appropriate preference for validation in human datasets, modest sycophancy increases from emphasized judge rubrics, and notable increases in inappropriate agreement from inference-time personalization, especially with matched user profiles placed before the query.
The paper proposes the GrAImes framework to use LLMs as auxiliary evaluators for literary fiction. Comparing LLM and human assessments of Spanish microfiction and short stories, it finds that LLMs cannot replace human judges (Krippendorff's alpha < 0.66) but can offer an initial perspective on editorial quality.
A study tests the overfitted brain hypothesis on a text-memory LLM agent: across 10 simulated days and 30 runs, corrupting conversation transcripts did not improve transfer, 40% detail corruption lowered recall from 76% to 60%, and random-text corruption had no consistent effect because the model recognized and excluded it.
This paper introduces FieldGuide, an agent-facing corpus map that organizes a document collection into a topic hierarchy and provides tools for corpus orientation, scoped search, and bounded reading. Evaluated on five journalistic document-exploration tasks using 38 Chicago Police Department public-records documents, FieldGuide used 27% fewer tokens and 41% less elapsed time than raw-file access, and 38% fewer tokens and 21% less elapsed time than RAG. An accuracy audit found four minor issues, comparable to other conditions. In blind ratings of generated reporting leads, FieldGuide scored higher than RAG but lower than raw-file access, suggesting that selective access may limit broad cross-document discovery.
Researchers present Limite 1B - Violetto, a one-billion-parameter model built for high-throughput mathematical reasoning. It was trained from scratch on 237 billion tokens from a curated mathematics-centric corpus and supports contexts up to 131k tokens. Post-training combines knowledge distillation, targeted supervised fine-tuning, and RLVR on a curated curriculum. The paper reports 94.01% on AIME 2026 and 74.25% on BeyondAIME, placing it among much larger models on the team's evaluation suite. The model is only lightly instruction-tuned and is positioned as a single-turn math solver and a fast parallel component of larger systems rather than a general assistant. The model, base and value checkpoints, and an optimized serving implementation are released under Apache 2.0.
Researchers introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations across 24 languages, to test whether multimodal LLMs keep a consistent understanding of information-rich visuals when the surface language changes. Evaluating 25 models shows that average accuracy hides large language-robustness gaps, and that every model performs worse with non-English visuals under fixed English QA.
Sleep2Word translates respiration, ECG, or PPG into EEG spectrograms using duration-aware physiological words, trained on over 20K PSG cases across 9 datasets, outperforming baselines in spectrogram reconstruction, sleep staging, arousal detection, and survival prediction while compressing full-night sequences by up to 69.7%.
Researchers introduce RAW, a method that uses LLM stochasticity as a natural experiment to causally measure how refusals affect user re-engagement from existing logs; across 15 deployed models, about half show a 3–17 pp re-engagement cost per refusal, at roughly $0.30 per 1,000 conversations.
CrisisBench is a privacy-preserving evaluation suite for crisis counseling AI, featuring single- and multi-turn tasks and simulated patient LLMs. Evaluations show all systems underperform human counselors on excessive empathy and questioning, though they excel at core structural competencies.
An arXiv paper accepted to the NeurIPS Creative AI Track 2026 presents Typhoon, an audiovisual installation that seeds a large language model with Joseph Conrad's novella and lets it feed endlessly on its own output. Using activation steering, including a new adaptive steering method, the authors control narrative rhythm and model digressions over long generations, showing that steering is both effective and unpredictable.
Researchers introduce GDP_xlsx, a benchmark of 70 realistic workplace requests from 13 domains, each paired with expert rubrics and complete spreadsheet files. Across 20 model configurations, the top-scoring Gemini 4 Argon passes only 38.3% of attempts under strict pass@1, with a median score of 19.3%, indicating substantial headroom for frontier models on professional spreadsheet tasks.
Researchers propose a full-block estimator for post-training masked diffusion language models that evaluates each block exactly once, eliminating block-selection variance and achieving lower variance than random block sampling. Experiments on five benchmarks show highest accuracy on four, with an average gain of 12.79 points over the baseline.
An EACL 2027 paper probes sentence-level semantics in massively multilingual self-supervised speech models across 76 languages. It finds that sentence meaning is linearly accessible from frozen speech representations but highly uneven across languages and resource tiers; cross-lingual probes can match language-specific probes on unseen languages, yet per-model monolingual decodability does not predict transfer. Scaling OmniASR wav2vec from 300M to 7B disproportionately benefits high-resource languages, and ASR tuning improves semantic decodability while making representations more language-specific. Semantic content is also entangled with acoustics, inflating performance on single-speaker corpora.
A new arXiv paper evaluates small open-weight language models (8-36B parameters) for crowd decision-making on restaurant review classification. Repeating queries and output-level fusion stabilize results but do not eliminate sensitivity to participant sampling; systems output candidate sets rather than single winners. Three larger models match a hosted reference, suggesting local CDM is feasible.
The paper introduces CamSpokenNLI, a pilot spoken NLI dataset of 114 scenario-matched items in each of Cameroon Pidgin English and Camfranglais, recorded by one native speaker from Buea. XLM-RoBERTa baselines reach 44.7% and 46.2% on reference text but are statistically indistinguishable from hypothesis-only input; disjoint-item cross-variety transfer scores 40.1% and 45.6%, while a counterpart-leak audit inflates them to 60-64%. Zero-shot Whisper transcription is poor, with best word error rates of 66.6% and 45.5%, and Whisper Large-v3 mislabels 93 of 114 Pidgin recordings as Yoruba or Swahili.
An arXiv paper introduces "dialectical competence"—the ability to know when to hold or yield a position—as a capability distinct from accuracy, and trains it through self-generated antitheses with verifiable rewards, requiring no second model, reward model, or human annotation.
This paper introduces ActGCG, a method that optimises an input suffix to match target activations produced by activation steering, enabling black-box reproduction of steering vector behaviour. Experiments show that for steering a model to answer in German, a discrete suffix almost perfectly replicates the steering vector's effect and transfers across prompts and models, while for anti-refusal steering the equivalence is weaker, succeeding under a phrase-avoidance metric but only partially under the stricter HarmBench classifier.
An arXiv paper by Vincent Cellucci and a co-author investigates whether AI can write an infinite poem through two experiments on couplets. The results show LLMs can produce interesting pairings but still lack human-level creativity and understanding of poetic relationships, while suggesting poetry may revive by incorporating AI workflows.
A TACL-accepted paper by Yang Wang and six co-authors proposes a task-centric framework that characterizes the model-internal processing elicited by benchmarks using attention-, activation-, and representation-based signals. Evaluating 16 LLMs across 24 benchmarks, it finds systematic processing differences between knowledge-centric and reasoning-centric tasks.