本文にスキップ
AI News HubLIVE

モデル価格の最新ニュース

Moonshot AI、Kimi K3.1 Proを公開:総パラメータ2.8T・アクティブ104BのMoEモデル、100万トークン文脈に対応

Moonshot AIはK3.1シリーズの第一弾となるKimi K3.1 Proを発表した。総パラメータ2.8T、アクティブパラメータ104BのMoEモデルで、100万トークンのコンテキストウィンドウを持つ。Terminal-Bench 4.0では65.7%を記録しClaude Opus 5.5に0.7ポイント及ばないものの、API価格は100万トークンあたり入力2ドル・出力10ドルとK3より安価。オープンウェイトは2026年11月に公開予定で、現時点では自前ホストできない。

MarkTechPostサイト内本文Moonshot AI、Kimi K3.1 Proを公開:総パラメータ2.8T・アクティブ104BのMoEモデル、100万トークン文脈に対応

Kimi K3.1 Pro 発表:オープンウェイトモデルが初めてフロンティア水準に迫る

ムーンショットは10月23日、Kimi K3.1 Pro を Kimi API で提供開始した。現時点ではオープンウェイトではないが、同社は「完全なモデルウェイトを2026年11月4日までに公開する」と約束している。価格は入力100万トークンあたり2ドル、出力100万トークンあたり10ドルで、GPT-6.1 Sol と同水準、Claude Opus 5.5 の半額にあたる。Artificial Analysis のスコアは55で、58の Claude Opus 5.5 に次ぐ順位となり、(近く)オープンウェイトになるモデルとしては初めてフロンティアにこれほど肉薄した。

Simon Willison's Weblogサイト内本文Kimi K3.1 Pro 発表:オープンウェイトモデルが初めてフロンティア水準に迫る

You.comがInference Routerを発表:12のオープンウェイトモデルを99.9%稼働SLAで提供

You.comは、OpenAI互換のマネージドAPI「Inference Router」を公開した。12のオープンウェイトモデルへリクエストを振り分け、最低99.9%の稼働SLA、ゼロデータ保持、100%米国内ホスティング、サーバーサイドのウェブ検索、プラットフォーム手数料無料をまとめて提供する。トークン単価は市場並みで、訴求点は価格ではなく保証にある。

MarkTechPostサイト内本文You.comがInference Routerを発表:12のオープンウェイトモデルを99.9%稼働SLAで提供

カルテルを誰が執行しているのか:強化学習は市場のLLMエージェントに何を教えるか

本論文は、LLM価格設定エージェントの共謀に関する既存の評価が結果のみに注目し、共謀を定義づける「執行」を見落としていると指摘する。著者らは、市場の反事実的コピーにおいてメンバーに違反を強制することで執行を検証する監査手法を導入し、強化学習が価格設定や取引においてエージェントに何を教えるかを調べる。

arXiv Computational Linguisticsサイト内本文カルテルを誰が執行しているのか:強化学習は市場のLLMエージェントに何を教えるか

翻訳待ち:Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Recursive has released Flint, an Apache 2.0 local coding model with 40B total and 2.5B active parameters. It reports 74.2% on SWE-bench Verified and 125+ tokens per second on an M4 Pro MacBook Pro. The post Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params

翻訳待ち:Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio--Text Cross-Attention

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.26868v1 Announce Type: new Abstract: Ambivalence and hesitancy (A/H) are subtle behavioural states that can be expressed through both what a person says and how it is spoken. This paper presents an audio--text framework for video-level A/H recognition. Full-video transcripts and speech waveforms are encoded using pre-trained multilingual BERT and wav2vec~2.0, respectively, and projected into a shared representation space. Two stacked bidirectional cross-attention blocks allow linguistic tokens to attend to acoustic frames and acoustic frames to attend to linguistic context without requiring explicit temporal alignment. The resulting sequences are aggregated through masked mean pooling and combined using concatenation, element-wise product…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio--Text Cross-Attention

翻訳待ち:Battle Drones - a vibe coded RTS with audio-based multiplayer

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要: My latest vibe coded game experiment is a Command & Conquer style RTS (Real Time Strategy) game called Battle Drones (play it here). Unlike my previous experiments, this one is actually fun to play. I'm somewhat embarrassed to admit that I got there by telling Claude to "Make it a LOT more fun". It also supports multiplayer between nearby devices using audio to synchronize game state! Here's what I've built so far, and some of the things I learned along the way. Battle Drones How I built this v1: the initial prototype v2: full sprites v3: varied terrain v4: the fun update v5: Battle Drones goes 3D v8: Archipelago v10: Goliath, and agent battles Agent battles v11: Random Maps v12: Multiplayer via sound Some thoughts Battle Drones My initial goal was…

Simon Willison's Weblog原典の内容 · 翻訳・分析待ち翻訳待ち:Battle Drones - a vibe coded RTS with audio-based multiplayer

翻訳待ち:Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Second

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Inception released Mercury 3, a diffusion LLM it says runs at 1,068 tokens per second with a 1M-token context. On Inception’s own table it leads GPT-6 Luna and Claude Haiku 5.5 on 8 of 12 benchmarks. The post Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Second appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Second

翻訳待ち:Meet Drex Max: Nace AI’s Multimodal Decision Model for Computer-Use Agents with a Score 67.59

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Nace AI released Drex Max, a multimodal decision model that reads text and screenshots and returns calibrated probabilities. Nace reports 67.59 on Decision Index 0.3.2 at $0.06 per 1M input tokens. The post Meet Drex Max: Nace AI’s Multimodal Decision Model for Computer-Use Agents with a Score 67.59 appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Meet Drex Max: Nace AI’s Multimodal Decision Model for Computer-Use Agents with a Score 67.59

翻訳待ち:Pearl-Chat: Engineering a native Luganda language model from first principles in JAX and Flax NNX

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.22529v1 Announce Type: new Abstract: Autoregressive foundation language models predominantly target high-resource Indo-European languages, imposing computational and morphological penalties on under-represented African languages. Generic multilingual tokenizers routinely exceed fertility rates of 3.2 tokens per word on agglutinative Bantu languages, degrading context efficiency and inflating latency. We present Pearl-Chat, an 8,473,122-parameter ($\sim$8.5M) causal decoder-only transformer engineered for Luganda (Oluganda, ISO 639-2: lg), a low-resource Niger-Congo Bantu language spoken by over 10 million people in East Africa. Built from first mathematical principles in JAX and Flax NNX, Pearl-Chat uses explicit functional state decompos…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Pearl-Chat: Engineering a native Luganda language model from first principles in JAX and Flax NNX

翻訳待ち:Where Prefill Expert Reduction Hurts MoE Models: A Few Prompt Tokens Carry Most of the Short-Answer F1 Loss

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.22454v1 Announce Type: new Abstract: Running prompt tokens through fewer routed experts during prefill is a simple way to make mixture-of-experts (MoE) serving cheaper, yet it is unclear what this damages. We locate the damage with token-, layer- and attention-path interventions on short-answer question answering in four MoE families. At half the experts the F1 loss of three families is mostly answer form: the model still finds the answer but stops answering briefly. In Qwen3-30B-A3B this loss is made at the two chat-template tokens before the answer, and in DeepSeek-V2-Lite at the first 8-32 prompt tokens, where its instruction sits; by answer likelihood these positions account for about half and a fifth of the damage. Reduction changes…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Where Prefill Expert Reduction Hurts MoE Models: A Few Prompt Tokens Carry Most of the Short-Answer F1 Loss

翻訳待ち:Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.22428v1 Announce Type: new Abstract: In a small language model the vocabulary is the single largest part. In Gemma 3 270M the embedding table holds 168M of 268M parameters, and because quantisation methods leave the embedding in 16-bit, it is also most of the file once the rest of the model is compressed. We ask what that table actually buys. We replace it with one frozen table of 512-bit codes, 16 MB, with no trainable parameters, derived once from a pretrained embedding by principal-component projection and sign binarisation, and we train the same Gemma-shaped body from scratch on the same 2.05B tokens with and without it. The learned table buys 0.20 nats of validation loss for 2.6 times the trainable parameters, but on LAMBADA, HellaSw…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models

翻訳待ち:Trust but Verify: Designing Region-Inhomogeneous Forward Dynamics for Discrete Diffusion

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.22380v1 Announce Type: new Abstract: Continuous diffusion treats the forward process as a design space; discrete language diffusion often uses absorbing corruption, leaving context fully trusted throughout generation. This makes trust binary: corrupted context is copied as ground truth, propagating errors into generated spans. We reopen this design space by combining absorbing and uniform-mixing kernels with region-dependent rates. Missing positions follow absorbing dynamics, while context undergoes low-rate random substitution, exposing the model to observed but uncertain tokens during training. At inference, a heuristic sampler re-injects noise into suspicious context under an annealed intensity and freezes context updates late in the t…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:Trust but Verify: Designing Region-Inhomogeneous Forward Dynamics for Discrete Diffusion

翻訳待ち:llm-echo 0.5

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要: Release: llm-echo 0.5 I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it. The new release now updates the simulated token usage counts to take tool calls, system prompts, and reasoning tokens into account. Example usage: uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage Outputs: First I consider the prompt, then I decide what to say. { "prompt": "hi there", "system": "", "attachments": [], "stream": true, "previous": [] } Token usage: 2 input, 24 output Tags: llm

Simon Willison's Weblog原典の内容 · 翻訳・分析待ち翻訳待ち:llm-echo 0.5

翻訳待ち:TinyFish Makes Search Free: What It Really Costs an AI Agent to Read the Web

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:An AI agent that reads the web pays 2 kinds of cost. The first is the retrieval charge: what a search or fetch API bills per request. The second is model processing: content passed from retrieved pages into an AI model consumes tokens, while reasoning and generated responses add further costs. TinyFish, a web infrastructure […] The post TinyFish Makes Search Free: What It Really Costs an AI Agent to Read the Web appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:TinyFish Makes Search Free: What It Really Costs an AI Agent to Read the Web

翻訳待ち:StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:StepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope. Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is […] The post StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

翻訳待ち:Liquid AI Releases d1-ultra: A Multimodal Decision Model That Scores 65 on the AA Decision Index

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Liquid AI released d1-ultra, a text and image decision model that returns calibrated probabilities in 1 forward pass. It scores 65 on the Artificial Analysis Decision Index and costs $0.042 per million input tokens. The post Liquid AI Releases d1-ultra: A Multimodal Decision Model That Scores 65 on the AA Decision Index appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Liquid AI Releases d1-ultra: A Multimodal Decision Model That Scores 65 on the AA Decision Index

翻訳待ち:Multi-Dimensional Featurizers Yield Fine-Grained Steering and Data Shaping in Robot Foundation Models

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20767v1 Announce Type: new Abstract: Can better feature discovery improve control over robot behavior through internal interventions and training data? Recent work in vision and language models reveals multidimensional features, motivating block-sparse featurizers (BSFs), which represent each feature in a low-dimensional subspace. We investigate whether recovering this structure provides an interpretable interface for steering vision-language-action models and shaping the data from which they learn. We show that BSFs recover several multi-dimensional task-relevant features underlying the model's computation (e.g., perception, language, proprioceptive state, episode phase, and control variables). We causally validate these features through…

arXiv Robotics原典の内容 · 翻訳・分析待ち翻訳待ち:Multi-Dimensional Featurizers Yield Fine-Grained Steering and Data Shaping in Robot Foundation Models

翻訳待ち:Causal Analysis of Robot Foundation Models Enables Efficiency Gains

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20750v1 Announce Type: new Abstract: Vision-language-action (VLA) models are a promising approach to general purpose robot manipulation. While the internal computation of vision-language models, which compose the backbone of VLAs, has been studied extensively, less is known about how their perceptual and semantic representations are transformed into action in VLA models. We study this question mechanistically in three frontier VLA models ($\pi_{0.5}$, MolmoAct2, and MolmoBot) by analyzing the causal pathways through which the input image and the instruction shape actions. Across the three models, activation patching shows that causally relevant information influences the action expert (AE) through a narrow band of mid-to-late cross-attent…

arXiv Robotics原典の内容 · 翻訳・分析待ち翻訳待ち:Causal Analysis of Robot Foundation Models Enables Efficiency Gains

翻訳待ち:Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20818v1 Announce Type: new Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align naturally with text modeling but have limited representational capacity. Continuous and hybrid approaches retain richer visual representations, but they model text and images in heterogeneous spaces with different training objectives, potentially introducing optimization conflicts between modalities with misaligned representation spaces. These choices expose a central question: how to efficiently model high-capacity visual representations alongside textual content in a shared optimization space within a single backbone. We present Intern Lumina U2, to our kno…

arXiv Computer Vision原典の内容 · 翻訳・分析待ち翻訳待ち:Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

翻訳待ち:CoTS: Competitive Token Selection for Latent Reasoning in Large Language Models

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20642v1 Announce Type: new Abstract: Recent latent reasoning methods move beyond discrete Chain-of-Thought (CoT) by replacing sampled tokens with continuous soft embeddings or hidden states, enabling richer intermediate representations and preserving alternative reasoning paths. However, the need for latent reasoning varies across decoding steps: confident predictions favor discrete commitment, whereas ambiguous steps benefit from preserving multiple plausible alternatives. Existing approaches typically handle this variation through either global soft activation or hard switching based on uncertainty thresholds, treating latent intervention as an all-or-nothing decision rather than continuously adapting its strength. To address this limit…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:CoTS: Competitive Token Selection for Latent Reasoning in Large Language Models

翻訳待ち:AbridgeKV: Compressing Long Reasoning into the KV Cache of Learned Pause Tokens

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20641v1 Announce Type: new Abstract: Long chain-of-thought decoding is memory-bound: the KV cache of the generated tokens grows linearly with the test-time compute being spent. Evicting cache entries does not fix this, because a model never trained on a cache with entries removed generates longer, often up to the length limit. We instead train the model to compress its own output. AbridgeKV compresses each completed block of generated text into the KV entries of a few learned pause tokens. These are extra input tokens with trained embeddings that produce no output. Once the pause tokens have encoded the block, AbridgeKV frees the block's original cache; subsequent tokens attend to the pause tokens' KV entries in its place. Three novel cho…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:AbridgeKV: Compressing Long Reasoning into the KV Cache of Learned Pause Tokens

翻訳待ち:TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20682v1 Announce Type: new Abstract: We introduce TurboMamba, a language-model architecture for faster inference, faster training, and better token prediction. A global Mamba-3 model runs once per completed token block. A small Transformer uses this global context and earlier tokens within the block to predict the next token. Three lightweight additions improve local predictions: direct access to the previous block's last token, a small correction to next-token scores, and a learned mixture with recent-token frequencies. We compare twelve small-scale implementations on public FineWeb-Edu, with comparable parameter counts and shared training-budget caps. The baselines include Transformer, Mamba-3, Jamba, and Zamba. The Jamba and Zamba vers…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory

翻訳待ち:Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20680v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) are typically trained on hundreds of millions to billions of activation tokens, yet little work has tested whether this scale is necessary. We study how much activation data SAEs need by training four SAE architectures on three language models with budgets ranging from 5M tokens to a 500M-token reference. We measure two notions of convergence: functional behavior on standard evaluations and one-to-one reproducibility of learned features. Functional data requirements are strongly metric-dependent: reconstruction often approaches the full-data reference at substantially smaller budgets, whereas feature reproducibility continues to improve with data. For Gemma-2-2B BatchTopK, th…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility

翻訳待ち:Expanding Attention: A Taylor-Series Route to Linear-Time Transformers with a Fixed Number of Recurrent States

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.20637v1 Announce Type: new Abstract: We expand the exponential kernel of attention into a truncated Taylor series of $n$ terms and factorize each term into a tensor-power inner product, which collapses the causal history into exactly $n$ recurrent states, each updated by one rank-one outer product per token and independent of context length $N$. The recursion is lossless with respect to the truncated kernel ($2.2 \times 10^{-16}$ in float64), and the states are additive across chunks ($5.7 \times 10^{-14}$), so prefill admits a parallel scan. Measured exponents are $t \propto N^{2.28}$ for softmax against $N^{0.91}$ for states, with a crossover at $N \approx 728$ and $20.8\times$ at $N = 8192$; per-token decoding latency is constant at $7…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:Expanding Attention: A Taylor-Series Route to Linear-Time Transformers with a Fixed Number of Recurrent States

翻訳待ち:From Copying to Composition: How Language Models Develop In-Context Learning

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.19113v1 Announce Type: new Abstract: In-context learning (ICL) allows language models to adapt their behavior from instructions and demonstrations in a prompt, but accuracy alone does not reveal how contextual information controls their predictions. We study the acquisition and trainability of ICL with a controlled diagnostic that separates copying a nearby demonstration from integrating information across the prompt. Across 17 models, about a third prefer the copied answer, a few are undecided, and the rest prefer the rule-consistent answer, which goes with higher accuracy and with control by the requested value rather than the closest conflicting example. Checkpoint analyses show that models begin prioritizing task-relevant prompt token…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:From Copying to Composition: How Language Models Develop In-Context Learning

翻訳待ち:Joint Subspace Sparse Attention for Efficient Long-Context Decoding

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.19026v1 Announce Type: new Abstract: Sparse attention reduces the KV-cache traffic that dominates long-context LLM decoding, but practical methods largely operate at coarse granularity. Token-level selection offers finer control, yet presents two challenges: low-dimensional scoring may lose query--key structure needed for accurate ranking, while gathering scattered selected tokens can offset the resulting latency benefit. We introduce Joint Subspace Sparse Attention (JSSA) to address both challenges. For selection quality, JSSA learns a shared low-dimensional query--key subspace by minimizing token-score preservation error. We upper-bound the resulting non-convex objective with a tractable marginal objective that admits a closed-form spec…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Joint Subspace Sparse Attention for Efficient Long-Context Decoding

翻訳待ち:How Many Ranks Does a Token Need? A Noise-Floor Squelch for Rank-One LoRA Experts

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.19033v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) applies every rank-one component of its update to every token, and mixture-of-experts variants replace this with a learned router that activates a fixed number of components. We argue that the number of components a token needs is a detection question with a classical answer. A token's responses to the rank-one components of a trained LoRA consist of a few large values on a Gaussian noise floor whose width matches that of an untrained adapter, and the floor carries cross-talk rather than adaptation. We introduce SQUELCH, a router-free mixture of rank-one experts that (i) soft-thresholds each token's responses at a multiple of its own robust noise level, so the active rank var…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:How Many Ranks Does a Token Need? A Noise-Floor Squelch for Rank-One LoRA Experts

翻訳待ち:Lotus: Learning to Understand Time-series by Learning to Forecast

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.18877v1 Announce Type: new Abstract: Time-series language models typically align numerical signals with language using labels, captions, or question-answer pairs. Although such supervision encourages linguistic representations, it does not explicitly require them to preserve information about how the underlying time-series signal evolves. We introduce forecast grounding, a pretraining principle that requires language-aligned time-series representations to remain predictive of the future evolution before they are adapted to downstream tasks. We instantiate this principle in LOTUS, which divides each time-series channel into non-overlapping patches and maps them into the LLM embedding space. It then predicts the next patch from the LLM hidd…

arXiv Machine Learning原典の内容 · 翻訳・分析待ち翻訳待ち:Lotus: Learning to Understand Time-series by Learning to Forecast

翻訳待ち:Unconstrained CTI-REALM with Open-Weights

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.14180v1 Announce Type: new Abstract: Organisations that want language-model agents for security work face a choice between open-weight models, which they can run and audit themselves, and far more expensive closed frontier models. We study that choice on CTI-REALM (arXiv:2603.13517), a benchmark in which an agent turns a threat-intelligence report into a working detection by querying a live telemetry store. We evaluate twenty-six models, nineteen open-weight and seven closed, under a common harness, scorer and panel of LLM judges. Our main finding is that an open-weight model can match the strongest closed models at less than a tenth of their cost, provided it is given enough turns. The benchmark's published limit on agent messages is a c…

arXiv AI原典の内容 · 翻訳・分析待ち翻訳待ち:Unconstrained CTI-REALM with Open-Weights

翻訳待ち:Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Tool-augmented LLM agents discover relevant APIs from large registries before planning execution, yet finite context windows prohibit injecting all tool definitions into a single prompt. The dominant approach, which we term Retrieve-then-Plan (RtP), embeds the user query and retrieves similar tools via approximate nearest-neighbor search. We study an alternative Plan-then-Retrieve (PtR) paradigm in which the LLM first generates Abstract Tool Stubs (hypothesized function signatures describing needed capabilities) which then serve as retrieval queries against the registry. Evaluating on…

Apple Machine Learning Research原典の内容 · 翻訳・分析待ち翻訳待ち:Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

翻訳待ち:Meta Muse Spark Open is live on Together AI

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Meta Muse Spark Open, Meta's open-weight model for agentic coding, is live on Together AI with a 1M-token context window on serverless and dedicated infrastructure.

Together AI Blog原典の内容 · 翻訳・分析待ち翻訳待ち:Meta Muse Spark Open is live on Together AI

翻訳待ち:“Take work away from frontier LLMs”: Subquadratic’s decision model claims 12x Jev’s context window

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Jev has a lot to answer for. Ever since AI startup TypeSafe unveiled the decision model in mid-September, the industry The post “Take work away from frontier LLMs”: Subquadratic’s decision model claims 12x Jev’s context window appeared first on The New Stack.

The New Stack AI原典の内容 · 翻訳・分析待ち翻訳待ち:“Take work away from frontier LLMs”: Subquadratic’s decision model claims 12x Jev’s context window

翻訳待ち:Liquid AI Releases LFM2.5-24B-A2B: A 2B-Active MoE for On-Device Agents

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Liquid AI released LFM2.5-24B-A2B, an open-weight 24B Mixture-of-Experts reasoning model with 2B active parameters. It targets local agents, scoring 48.09 on LiveClaw and decoding 184 tokens/s on an Apple M5 Max. The post Liquid AI Releases LFM2.5-24B-A2B: A 2B-Active MoE for On-Device Agents appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Liquid AI Releases LFM2.5-24B-A2B: A 2B-Active MoE for On-Device Agents

翻訳待ち:Google Releases Gemini 4 Argon API With 1M Token Output Limit

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Google has made Gemini 4 Argon generally available on the Gemini API, AI Studio and the Gemini app. The sparse MoE model writes up to 1M output tokens and leads the Vals Index at 68.90%. The post Google Releases Gemini 4 Argon API With 1M Token Output Limit appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Google Releases Gemini 4 Argon API With 1M Token Output Limit

翻訳待ち:llm-gemini 0.35

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要: Release: llm-gemini 0.35 I added support to llm-gemini for the new Gemini 4 Argon model, made available today via the Gemini API and for customers of their $100/month subscription plan. Here are the low, medium and high pelicans. As expected, they are all excellent: Gemini has a track record of producing great SVGs, and are the only lab where I know their staff have invested in SVG specifically (and who have boasted about their pelicans before.) Here's the "high" illustration, which cost me 17.166 cents: The pricing is interesting. At launch, Argon is $2/million input and $10/million output - the same price as GPT-6 Sol, half the price of Claude Opus 5.5 and 1/5th the price of Claude Fable 5.1 and GPT-6 Astra. But on December 1st Argon is set to do…

Simon Willison's Weblog原典の内容 · 翻訳・分析待ち翻訳待ち:llm-gemini 0.35

翻訳待ち:Alibaba Qwen Introduces QwenGyre: Elastic Reinforcement Learning RL for XLong-Horizon Agents

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Alibaba’s Qwen team has introduced QwenGyre, an elastic reinforcement learning RL framework for extreme-long-horizon agent training. QwenGyre is an online reinforcement learning system from Alibaba that trains coding agents through unmodified, black-box harnesses. It targets rollouts that run for hours and process close to 1M tokens. The QwenGyre elastic RL framework was used on Qwen’s […] The post Alibaba Qwen Introduces QwenGyre: Elastic Reinforcement Learning RL for XLong-Horizon Agents appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Alibaba Qwen Introduces QwenGyre: Elastic Reinforcement Learning RL for XLong-Horizon Agents

翻訳待ち:Scaling Multi-Teacher Distillation for Digital Pathology

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.12574v1 Announce Type: new Abstract: Multi-teacher distillation allows transferring knowledge from multiple "teacher" networks to a single "student" network. This method is promising in fields such as digital pathology, where many powerful foundation models were proposed recently. However, as we show in this paper, the standard multi-teacher distillation approach reacts poorly to an increase in the number of teachers used to train a student encoder. We demonstrate that learning teacher-specific representations is a key to scaling in MTD. Importantly, different design choices, such as learnable teacher tokens, a tailored attention scheme, additional mixture-of-experts layers and a contrastive loss, are proposed to better learn such teacher…

arXiv Computer Vision原典の内容 · 翻訳・分析待ち翻訳待ち:Scaling Multi-Teacher Distillation for Digital Pathology

翻訳待ち:Contextual Correction of Parallel Draftsfor Speculative Decoding

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.12570v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference by using a lightweight drafter to propose multiple tokens that are subsequently verified in parallel by the target model. Recent diffusion-based drafters make this paradigm particularly attractive: deep attention-based neural backbones provide strong predictions, while drafting multiple future positions in parallel avoids the sequential cost of autoregressive generation. This parallelism, however, comes at a cost. Tokens within a draft block are predicted without access to the realized identities of preceding draft tokens, removing intra-block dependencies that would naturally be available under autoregressive generation. We introduce DCOC…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Contextual Correction of Parallel Draftsfor Speculative Decoding

翻訳待ち:AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.12545v1 Announce Type: new Abstract: Autoregressive decoding is less suited to non-causally ordered data, e.g., cross-references or future dependencies, since their outputs cannot be revised post hoc, unlike iterative human reasoning. Diffusion LLMs partially mitigate this limitation but still cannot flexibly insert or remove arbitrary numbers of tokens from a pre-generated context. We design AutoIndexer as a generative model with a novel training and decoding mechanism that simulates a Chain of Edits, allowing the model to flexibly modify its prior outputs in hindsight via token insertions, substitutions, and deletions. The model learns to predict marker tokens for opening and closing edits, simultaneously moving a cursor to positions in…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits

翻訳待ち:Faithful and Complete LLM-Assisted Automated Construction of Hierarchical Hardware Knowledge Graphs

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.12762v1 Announce Type: new Abstract: Hardware datasheets contain engineering specifications essential for component selection, system integration, and hardware compatibility verification. However, manual inspection is tedious and error-prone because datasheets are lengthy and heterogeneous, with dense information fragmented across tables, figures, and text. Although large language models (LLMs) can automate this process, na\"ive one-shot processing omits relevant specifications even when the document fits within the model's context window. We present an automated LLM-driven pipeline that transforms hardware datasheets into general-purpose hierarchical hardware knowledge graphs through chunk-based property extraction, hierarchical routing,…

arXiv AI原典の内容 · 翻訳・分析待ち翻訳待ち:Faithful and Complete LLM-Assisted Automated Construction of Hierarchical Hardware Knowledge Graphs

翻訳待ち:Self-Compacting Language Model Agents

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Long agent traces composed of chains of thought and tool calls accumulate stale content that anchor subsequent generations, and eventually outgrow the context window. Existing scaffolds mitigate it with fixed-interval compaction triggered at a token threshold. Such triggers pay no heed to trajectory structure, risking discard of partial results mid-derivation or mid-search. We propose SELFCOMPACT, a scaffold that allows the model itself to decide when and how to compact. Specifically, it pairs two inference-time elements: (i) a compaction tool the model invokes to summarize the accumulated…

Apple Machine Learning Research原典の内容 · 翻訳・分析待ち翻訳待ち:Self-Compacting Language Model Agents

翻訳待ち:Meet Cloudflare Clef-omni: A 30B-A3B Multimodal Decision Model for Audio, Video, Image and Text

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:Cloudflare released Clef-omni, an Apache-2.0 multimodal decision model built on Qwen3-Omni-30B-A3B. It scores text, images, audio and video in one call for $0.15 per million input tokens, while Clef-flash drops to $0.038. The post Meet Cloudflare Clef-omni: A 30B-A3B Multimodal Decision Model for Audio, Video, Image and Text appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:Meet Cloudflare Clef-omni: A 30B-A3B Multimodal Decision Model for Audio, Video, Image and Text

翻訳待ち:OpenAI Decisions API Hits Public Beta With 10x Faster Typed Answers

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:OpenAI’s Decisions API is now in public beta on GPT-6 Luna. It returns typed probabilities, choices and scores about 10x faster than the Responses API, billing $0.10 per 1M input tokens with no output charges. The post OpenAI Decisions API Hits Public Beta With 10x Faster Typed Answers appeared first on MarkTechPost.

MarkTechPost原典の内容 · 翻訳・分析待ち翻訳待ち:OpenAI Decisions API Hits Public Beta With 10x Faster Typed Answers

翻訳待ち:NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.10787v1 Announce Type: new Abstract: Language models trained with long-horizon agentic reinforcement learning can generalize knowledge through reasoning, express precise actions, and pursue goals over many steps, raising the ceiling on what an embodied agent can understand and decide. Physical interaction, however, remains the domain of action policies, which provide dense, low-latency control. We present NavGPT-3, a harness that connects the two models, with an OS-like runtime built above it: reasoning, acting, and monitoring run as threads with their own context, tools, and permissions, while the runtime schedules them and decides which thread controls the robot's motion, so that the robot can react to sudden real-world events through i…

arXiv Robotics原典の内容 · 翻訳・分析待ち翻訳待ち:NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime

翻訳待ち:Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.10845v1 Announce Type: new Abstract: A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every time the prompt is sent. We test a memory layer, the public package galahad-kv, that saves the KV state of each block of about 16,000 tokens to encrypted local NVMe disk and loads it back later, byte-exact, without recomputing it. We ran it on 50,000,000 tokens of real public text, served through vLLM on one NVIDIA H100, with Gemma 4 12B and Gemma 4 31B. Every block we probed was loaded back from the encrypted store with no recompute (100 of 100, at depths from 0 to 50M tokens) on both models. Loading a block was 2.8x to 4.3x faster than recomputing it and…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute

翻訳待ち:Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.10592v1 Announce Type: new Abstract: Historical Polish is well documented as a language but annotated in machine-readable form only to about a million words for the period this paper covers; the rest sits behind optical character recognition of variable quality. We present Wieszcz-XIX, a corpus of 6.75 billion tokens (about 3.1 billion words) in 294,369 documents, most of them periodical issues, of Polish published from 1800 to 1918, assembled from Wolne Lektury and the Internet Archive by a pipeline that filters, deduplicates, audits for post-1918 leakage and splits at the document level. It is over three orders of magnitude larger than the annotated corpus of the same period, and we quantify its defects: recognition corruption against a…

arXiv Computational Linguistics原典の内容 · 翻訳・分析待ち翻訳待ち:Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch

翻訳待ち:Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要:arXiv:2610.10590v1 Announce Type: new Abstract: Tool-using agents repeatedly carry observations whose useful content can be much smaller than their original payload. We study agent-controlled forgetting: the acting model selects previously observed tool results, replaces each with a short note at its original position, and retains the exact original in a recoverable archive. A Python harness exposes batch archival and explicit recovery without task-specific model training, while protecting user instructions and assistant messages from these operations. In an exploratory OpenTelemetry debugging case followed by an unrelated implementation task, the method ended with 231,951 provider-reported prompt tokens versus 912,492 under retained history, used 5…

arXiv AI原典の内容 · 翻訳・分析待ち翻訳待ち:Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice

翻訳待ち:ttok 1.0

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要: Release: ttok 1.0 I released ttok 0.4, ran uv tool upgrade ttok, piped a file into the new version... and realized that it was defaulting to the GPT-4 tokenizer when it should very clearly default to GPT-5/GPT-6 instead! I figured switching the default was a reasonable excuse to finally ship a 1.0. OpenAI haven't actually confirmed that GPT-6 uses the same tokenizer as the GPT-5 family yet - there's an angry issue about it - but I found this commit by William Liu which reports on an experiment he ran confirming that the tokenizers are likely the same: All seven GPT models (5.5, 5.6 Sol/Terra/Luna, 6 Astra/Sol/Luna) report 44,794 tokens and match each other on every one of the 31 fixtures. GPT-6 introduces no input-count change on this corpus. Tags:…

Simon Willison's Weblog原典の内容 · 翻訳・分析待ち翻訳待ち:ttok 1.0

翻訳待ち:ttok 0.4

AI サービスが一時的に利用できないため、復旧後に翻訳を補完します。ソース概要: Release: ttok 0.4 ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library. It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models. It works with uvx, so you can count tokens in anything like this: cat file.txt | uvx ttok Tags: projects, ai, openai, generative-ai, llms, tokenization

Simon Willison's Weblog原典の内容 · 翻訳・分析待ち翻訳待ち:ttok 0.4

その他の成長タグ