跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全2 分鐘閱讀

待翻譯:NVIDIA Releases Alpamayo 2 Super: A 34B Open Vision-Language-Action Model for Robotaxis and Autonomous Driving Under OpenMDW-1.1

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:NVIDIA released Alpamayo 2 Super, a 34B vision-language-action model for autonomous driving, under OpenMDW-1.1 — a permissive license covering fine-tuning, derivatives and commercial redistribution. It pairs a 32B Cosmos 3 Super Reasoner backbone with a 2.3B diffusion action decoder, scores 79.2 on LingoQA, and emits trajectories, Chain-of-Causation traces, meta-actions, auto-labels and grounded VQA from a single pass. The post NVIDIA Releases Alpamayo 2 Super: A 34B Open Vision-Language-Action Model for Robotaxis and Autonomous Driving Under OpenMDW-1.1 appeared first on MarkTechPost.

來源MarkTechPost作者: Asif Razzaq
待翻譯:NVIDIA Releases Alpamayo 2 Super: A 34B Open Vision-Language-Action Model for Robotaxis and Autonomous Driving Under OpenMDW-1.1
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

NVIDIA has released Alpamayo 2 Super, a 34B-parameter vision-language-action (VLA) model for autonomous driving, under an open commercial license. The stated design target is the long-tail events: rare, multi-agent situations that conventional detection-and-prediction stacks handle poorly. The model pairs a 32B VLM backbone, built on NVIDIA Cosmos 3 Super Reasoner and post-trained with reinforcement learning, with a 2.3B diffusion-based action decoder. From one pass over full-surround camera video it emits a planned trajectory, a causal explanation of that trajectory, and a meta-action. Is it deployable Yes, and for commercial use from day one. The weights are released under OpenMDW-1.1, the Linux Foundation’s permissive license for open model distributions; source code is Apache 2.0. The license covers fine-tuning, derivative models and commercial redistribution. NVIDIA is applying OpenMDW across the entire Alpamayo family, so earlier releases introduced for R&D are now deployable commercially without additional permission. Inputs, outputs and training data Inputs are multi-camera RGB video, text, and egomotion history with timestamps. The validated public notebook profiles use six cameras and four historical frames per camera. Egomotion is 3D translation plus a 3×3 rotation matrix, multi-timestep. The trajectory API returns 64 waypoints spanning 0.1 to 6.4 seconds at 0.1-second intervals. Each waypoint carries ego-frame XYZ and a 3×3 rotation matrix. Training data is roughly 115,000 hours of multi-camera driving video with egomotion and trajectory annotations. It includes about 3,700,000 Chain-of-Causation (CoC) traces — structured, causally linked explanations of driving decisions. Image training data exceeds one billion images. Benchmarks On LingoQA, Alpamayo 2 Super records a Lingo-Judge score of 79.2 and ranks first among nearly 40 models evaluated. In NVIDIA’s testing it beat Qwen2.5-VL 72B by 17.0 points, Gemini 2.5 Pro by 15.1, and GPT-4o by 23.2. Two more numbers matter for planning work. Closed-loop evaluation with AlpaSim on 910 scenarios from the PhysicalAI-AV-NuRec dataset gives an AlpaSim score of 1.50 ± 0.13. Open-loop evaluation on 937 challenging samples from the PhysicalAI-AV dataset gives minADE₆ at 6.4s of 0.911m. Five outputs from one model For each driving situation, the model produces a trajectory, a CoC trace explaining the decision, a meta-action such as yield or lane change, reasoning auto-labels, and visual question answering with 2D grounding. That combination is what makes the release interesting operationally. Developers can tie what the model observed to the action it chose. CoC traces integrate with NVIDIA Halos safety-validation workflows and support AI safety aligned with ISO/PAS 8800. Used as an autolabeler on proprietary fleet data, NVIDIA says the model compresses annotation cycles from months to days. Interactive explainer Key Takeaways 34B VLA model — 32B Cosmos 3 Super Reasoner backbone plus a 2.3B diffusion action expert. OpenMDW-1.1 weights and Apache 2.0 code; commercial use and redistribution allowed, no extra permission needed. LingoQA Lingo-Judge 79.2, first among nearly 40 models; AlpaSim 1.50 ± 0.13; minADE₆ 0.911m at 6.4s. One pass yields trajectory, Chain-of-Causation trace, meta-action, auto-labels, and grounded VQA. Cloud-scale model tested on 1× H100 80GB at 72,115 MiB peak; distill it for in-car inference. Check out the NVIDIA blog and Hugging Face model card. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us The post NVIDIA Releases Alpamayo 2 Super: A 34B Open Vision-Language-Action Model for Robotaxis and Autonomous Driving Under OpenMDW-1.1 appeared first on MarkTechPost.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • NVIDIA released Alpamayo 2 Super, a 34B vision-language-action model for autonomous driving, under OpenMDW-1.1 — a permissive license covering fine-tuning, derivatives and commerc…

技術影響

可能影響 GPU、推理集羣、算力成本和供應鏈規劃。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。