跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全3 分鐘閱讀

待翻譯:NVIDIA Releases Nemotron 3.5 Super VL, a 120B Open Multimodal Agent Model

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:NVIDIA released Nemotron 3.5 Super VL, an open 120B-parameter multimodal MoE model with 12B active parameters, 1M-token context and NVFP4 weights that run on 1 DGX Spark, plus 2 Bolt edge models. The post NVIDIA Releases Nemotron 3.5 Super VL, a 120B Open Multimodal Agent Model appeared first on MarkTechPost.

來源MarkTechPost作者: Asif Razzaq
待翻譯:NVIDIA Releases Nemotron 3.5 Super VL, a 120B Open Multimodal Agent Model
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

NVIDIA just released Nemotron 3.5 Super VL, an open vision-language model built for always-on enterprise agents. Nemotron 3.5 Super VL is a 120B-parameter mixture-of-experts model from NVIDIA that activates 12B parameters per token. It reads text, images, documents and video, then reasons, calls tools and writes code in one model. For developers, 1 open checkpoint replaces a separate text model along with a separate vision model. NVIDIA also shipped 2 edge models, Nemotron 3.5 Bolt 74B-A9B and Bolt E4B. TL;DR Size: 120B total parameters, 12B active (MoE). Context up to 1M tokens. Runs on: 1x DGX Spark, 1x H200, 2x H100 or 1x GB200 with the NVFP4 checkpoint. A BF16 checkpoint is also published. Performance: Strong reasoning, agentic coding and document vision. NVIDIA claims up to 5x higher single-GPU throughput than open peers. Best: 89.90 on GPQA-Diamond (NVFP4). Worst: 17.78 on tau3-bench banking (NVFP4). What is Nemotron 3.5 Super VL? It is an open multimodal agent model. Weights ship under the OpenMDW-1.1 license. NVIDIA also released open datasets, training recipes and RL environments in NeMo Gym. The model card lists text, image and video inputs with text output. Video is limited to MP4 clips up to 2 minutes. Reasoning can be toggled on or off through the chat template. How does the architecture work? The backbone interleaves Mamba-2, mixture-of-experts and attention layers. Each MoE layer holds 512 routed experts. A C-RADIO vision encoder and a connector feed images, document pages and video frames into the language backbone. Speed comes from four techniques: Multi-token prediction: a native drafter proposes several tokens, verified in 1 forward pass. LiLiCorr: a speculative drafter for DGX Spark, up to 2.3x faster token generation. NVFP4 with quantization-aware distillation: 4-bit weights and activations on Blackwell, 4-bit weights with 16-bit activations elsewhere. Context reuse: prefix caching keeps both attention caches and Mamba states across agent turns. The model was distilled from Nemotron 3 Ultra. NVIDIA team states that it trained on about 26 trillion tokens. Post-training used roughly 3.8 million samples plus RL across dozens of environments. Continued pretraining added 10B Indic tokens. How does it perform on benchmarks? All scores below are NVIDIA-reported, from the NVFP4 checkpoint on the model card. AreaBenchmarkScore ReasoningGPQA-Diamond89.90 CodingSWE-bench Verified71.07 CodingTerminal-Bench 2.160.80 Web agentBrowseComp77.5 Instruction followingIFBench71.50 ChartsCharXiv reasoning79.88 DocumentsMMLongBench-Doc62.82 Computer useOSWorld-Verified52.3 Long-horizon agenttau3-bench banking17.78 On agent harness evals, Super VL beats Nemotron 3 Ultra. It scores 63.44% on Hermes Bench versus 56.33%. On LangChain evals it scores 87.05% versus 84.3%. Ultra carries about 4.6x more total parameters. NVIDIA team reports over 600 output tokens per second on Artificial Analysis agentic tasks via a Baseten endpoint. Its chart marks a 5x speed gap over Inkling Small. How does it compare with similar open models? FeatureNemotron 3.5 Super VLQwen3.5-122B-A10BInkling-SmallNemotron 3 Ultra DeveloperNVIDIAAlibaba QwenThinking Machines LabNVIDIA Total / active params120B / 12B122B / 10B276B / 12B550B / 55B ContextUp to 1M262,144 native, extensible to 1,010,000Not disclosed on model cardEvaluated at 1M (Ruler @1M) InputsText, image, videoText, image, videoText, image, audioNot disclosed LicenseOpenMDW-1.1Apache 2.0Apache 2.0OpenMDW-1.1 Reference hardware1x DGX Spark, 1x H200, 2x H100 or 1x GB2008-GPU tensor-parallel serving exampleNot disclosedNot disclosed GPQA Diamond89.9086.689.5Not disclosed SWE-bench Verified71.0772.080.2 (bash-only harness)65 to 70.4 (across 5 harnesses) IFBench71.5076.182.282 CharXiv reasoning79.8877.277.4Not disclosed BrowseComp77.563.877.4 (with context management)Not disclosed Terminal-Bench60.80 (v2.1)49.4 (v2)64.7 (v2.1, best harness)54 (v2.0) Scores are self-reported by each vendor. Harnesses and benchmark versions differ, so treat gaps of a few points with caution. How can developers deploy it? Super VL is available on Hugging Face, OpenRouter, ModelScope and as an NVIDIA NIM. Supported runtimes are vLLM, SGLang and TensorRT-LLM on Blackwell and Hopper. Local paths include llama.cpp and Unsloth. For production, Dynamo recipes add KV-aware routing. On 16 B200 GPUs at 50 tokens per second per user, NVIDIA reports 8x more users served. First-token latency drops 85%. Customization runs through NeMo AutoModel for SFT and LoRA, and NeMo RL for reinforcement learning. NVIDIA cites early results: Scale AI for Skydance vendor credit processing: 40x lower inference cost and 5x lower latency. Ramp receipt-to-JSON extraction: up to 50% higher throughput and 10x lower latency expected. AI21 for Alice threat intelligence: 40% higher accuracy. What are the Nemotron 3.5 Bolt models? Nemotron 3.5 Bolt 74B-A9B targets local agents. NVIDIA’s launch notes describe it as distilled from Super VL. Native 2-bit quantization fits it into 24GB of memory on RTX and DGX Spark systems. NVIDIA says it ranks #1 among open models in its class on PinchBench. It ranks #2 on BrowseComp among open models. It is available now on Hugging Face with llama.cpp, Ollama, LM Studio, Unsloth and vLLM support. Bolt E4B 4GB arrives October 23. It targets voice assistants and embedded agents on GeForce RTX, Jetson and RTX or DGX Spark. Key Takeaways 120B MoE, 12B active, 1M context, open weights under OpenMDW-1.1. 1 model handles text, images, documents, video, tools and code. NVFP4 checkpoint runs on a single DGX Spark, H200 or GB200. 89.90 GPQA-Diamond, but only 17.78 on tau3-bench banking. Bolt 74B-A9B brings a 24GB local agent model to RTX PCs. Check out the technical report, model card and usage cookbook. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. The post NVIDIA Releases Nemotron 3.5 Super VL, a 120B Open Multimodal Agent Model appeared first on MarkTechPost.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • NVIDIA released Nemotron 3.5 Super VL, an open 120B-parameter multimodal MoE model with 12B active parameters, 1M-token context and NVFP4 weights that run on 1 DGX Spark, plus 2 B…

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。