跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全3 分鐘閱讀

待翻譯:JetBrains Releases Mellum2.1: A 12B MoE Open Model for Coding Agents

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:JetBrains released Mellum2.1, an Apache 2.0, 12B mixture-of-experts thinking model with 2.5B active parameters. RL in real repositories lifted its SWE-bench Verified score from 2.0 to 47.0. The post JetBrains Releases Mellum2.1: A 12B MoE Open Model for Coding Agents appeared first on MarkTechPost.

來源MarkTechPost作者: Asif Razzaq
待翻譯:JetBrains Releases Mellum2.1: A 12B MoE Open Model for Coding Agents
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

JetBrains has released Mellum2.1, an open model built for coding agents and fast sub-agents. Mellum2.1 is a 12B mixture-of-experts thinking model from JetBrains that activates 2.5B parameters per token. It ships under Apache 2.0 on Hugging Face. The architecture is unchanged from Mellum2. The upgrade comes almost entirely from reinforcement learning (RL) in real software environments. The result is a small, self-hostable model that explores a repository, edits files, and checks its own changes. TL;DR Size: 12B total, 2.5B active (64 experts, 8 active), 131,072-token context Runs on: your own GPUs via vLLM or SGLang (speed tested on 1 NVIDIA H200). GGUF builds start at 7.0 GB for llama.cpp, Ollama and LM Studio. Performance: beats Mellum2 on 15 of 17 listed benchmarks; wins 5 of 17 against Qwen3.5-9B Best: 82.0 on LiveCodeBench v6, ahead of Qwen3.5-9B (75.4) and Gemma 4 E4B (69.4) Worst: 17.4 on Terminal-Bench 2.1, below Qwen3.5-9B (21.7) Bottom line (best): strong coding scores and high throughput from only 2.5B active parameters. Bottom line (worst): still trails Qwen3.5-9B on hard agentic software tasks and knowledge. What is Mellum2.1? Mellum2.1 is the next version of Mellum2 Thinking, which JetBrains open-sourced in June 2026. The released checkpoint is Mellum2.1-12B-A2.5B-Thinking. It is a reasoning model that emits its chain of thought before answering. JetBrains targets 3 uses: agent worker, general reasoning assistant, and private self-hosted deployment. How does the Mellum2.1 architecture work? The model has 28 layers and 64 experts. A router activates 8 experts per token. Attention uses grouped-query attention with 32 query heads and 4 KV heads. 3 of every 4 layers use a 1,024-token sliding window. Context length is 131,072 tokens, and the vocabulary has 98,304 tokens. Weights ship in bfloat16. How was Mellum2.1 trained? Almost all of the new work went into post-training. RL moved from a short final stage to the main part of training. JetBrains added RL tasks in math, competitive programming, science, tool use, and software engineering. It filtered open RL datasets for broken tests, unverifiable answers, and tasks that were too easy or impossible. For software engineering, the model trains in real repositories with a shell and file-editing tools. It is rewarded when the tests pass. Training launched millions of sandboxes across thousands of environments. How does Mellum2.1 perform on benchmarks? JetBrains evaluated Mellum2.1, Mellum2, Qwen3.5-9B and Gemma 4 E4B with one pipeline in thinking mode. All scores are self-reported by JetBrains. The largest jump is agentic coding. SWE-bench Verified rose from 2.0 to 47.0. SWE-bench Pro rose from 0.0 to 28.0. Terminal-Bench 2.1 rose from 0.6 to 17.4. Agentic runs used the open-source Pi v0.73.1 harness with a 114K-token context. Mellum2.1 leads the group on LiveCodeBench v6 (82.0), HumanEval+ (91.5), MBPP+ (79.4) and BFCL v4 (62.3). Qwen3.5-9B still leads on SWE-bench Verified (50.0), SWE-bench Pro (38.0), AIME 25/26 (86.7) and GPQA Diamond (77.8). Safety also improved: HarmBench fell from 21.5 to 8.5, where lower is better. Pipelines are important to consider. Qwen’s own card lists 65.6 on LiveCodeBench v6 and 81.7 on GPQA Diamond. JetBrains measured 75.4 and 77.8 for the same model. How fast is Mellum2.1? Post-training left the architecture untouched, so speed matches Mellum2. On 1 H200 under heavy load, JetBrains says Mellum2.1 serves almost 2x the tokens of Qwen3.5-9B. For a single request, multi-token prediction (MTP) makes it about 1.6x faster. The MTP head for vLLM speculative decoding is listed as coming soon. How do you run Mellum2.1 locally? The full model serves on vLLM with --reasoning-parser qwen3. Tool calling adds --enable-auto-tool-choice --tool-call-parser hermes. JetBrains recommends temperature 0.6, top_p 0.95 and top_k 20. The JetBrains release notes mentions that GGUF builds are in progress. A GGUF repository already lists 5 files: BF16: 24.3 GB (reference) Q8_0: 12.9 GB, 96.1% top-token match Q6_K: 10.9 GB, 93.9% top-token match Q4_K_M: 8.1 GB, 88.0% top-token match (recommended) MXFP4_MOE: 7.0 GB, 85.6% top-token match Mellum2.1 vs Qwen3.5-9B vs Gemma 4 E4B FeatureMellum2.1Mellum2 ThinkingQwen3.5-9BGemma 4 E4B ArchitectureMoE, 64 experts, 8 activeMoE (same as 2.1)Hybrid Gated DeltaNet + gated attentionDense with per-layer embeddings Total params12B12B9B (language model)8B with embeddings Active / effective params2.5B active2.5B active9B (dense)4.5B effective Context131,072131,072262,144 native, up to 1,010,000128K ModalityTextTextText, image, videoText, image, audio LicenseApache 2.0Apache 2.0Apache 2.0Apache 2.0 LiveCodeBench v6*82.069.475.469.4 SWE-bench Verified*47.02.050.023.0 Terminal-Bench 2.1*17.40.621.73.4 BFCL v4*62.349.658.552.5 GPQA Diamond*64.651.077.853.1 AIME 25/26*83.360.186.745.0 *Benchmark rows: JetBrains’ shared pipeline, thinking mode, from the Mellum2.1 model card. Vendors’ own cards report different numbers for Qwen3.5-9B and Gemma 4 E4B. Key Takeaways Mellum2.1 is a 12B MoE thinking model with 2.5B active parameters, under Apache 2.0. RL in real repositories lifted SWE-bench Verified from 2.0 to 47.0. It leads the tested group on LiveCodeBench v6 (82.0) and BFCL v4 (62.3). Qwen3.5-9B still wins on SWE-bench Pro, GPQA Diamond and AIME. A 7.0 GB to 8.1 GB GGUF makes local coding sub-agents practical. Check out the model weights, GGUF builds, technical blog and the Mellum2 technical report. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. The post JetBrains Releases Mellum2.1: A 12B MoE Open Model for Coding Agents appeared first on MarkTechPost.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • JetBrains released Mellum2.1, an Apache 2.0, 12B mixture-of-experts thinking model with 2.5B active parameters. RL in real repositories lifted its SWE-bench Verified score from 2.…

技術影響

可能影響 Agent 架構、工具調用、工作流自動化和產品集成。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。

待翻譯:JetBrains Releases Mellum2.1: A 12B MoE Open Model for Coding Agents | AI News Hub