Ai2 Blog

AIMIP is a new open benchmark and dataset for evaluating AI climate models, showing they can match or beat conventional models on some historical climate metrics while still struggling to generalize reliably to long-term warming trends and unseen climate scenarios.

Artificial Analysis employs Ai2's open IFBench evaluation because it captures a stubborn, real-world capability many benchmarks miss: whether models can reliably follow complex, multi-part user instructions.

EMO is a new mixture-of-experts model trained so modular expert groups emerge from data, enabling users to select small task-specific expert subsets while preserving near full-model performance.

Ai2 is bringing NSF OMAI compute online to power a fully open AI research ecosystem, turning national infrastructure investment into reusable models, data, methods, and tools that can accelerate scientific discovery.

MolmoAct 2 is a fully open robotics foundation model with faster 3D action reasoning, a new bimanual dataset, and strong zero-shot performance on real-world tasks.

Interim CEO Peter Clark discusses Ai2's ongoing commitment to open science amidst rapid AI progress, highlighting key projects, the NSF OMAI initiative, and future directions in AI for science, embodied AI, and environmental AI.

AstaBench’s latest update adds new frontier-model results, including GPT-5.5, and highlights growing adoption from groups including the UK AISI, General Reasoning, Elicit, SciSpace, Distyl AI, and EvoScientist.

Ai2 releases MolmoPoint and MolmoWeb, extending the Molmo family from visual understanding to visual action. MolmoPoint achieves state-of-the-art pointing by selecting directly from input data, while MolmoWeb is a vision-based web agent that navigates websites via screenshots and mouse/keyboard actions, outperforming many open and closed models. Both are open-source.

OlmPool is a controlled suite of 26 models showing how small architecture choices can compound to make long-context extension much harder, even when training data and extension recipes are held constant.

OlmoEarth Studio now lets users export custom Earth-observation embeddings from our OlmoEarth foundation models and use them for tasks like similarity search, few-shot mapping, change detection, and unsupervised exploration.

For the past 10 years, Ai2 has built open, real-time tools that help people protect wildlife, oceans, and ecosystems around the world.

BAR is a recipe for post-training language models one capability at a time—train domain experts independently, merge them into a single mixture-of-experts model, and upgrade any expert without impacting the others.

Two benchmarks developed at Ai2 – ScienceWorld and DiscoveryWorld – reveal that even incredibly strong AI science agents struggle with problems human scientists solve routinely. ScienceWorld tests basic experiment execution, while DiscoveryWorld evaluates end-to-end scientific discovery. Current top models score ~80% on ScienceWorld and only ~20% on hard DiscoveryWorld tasks, compared to ~70% for human scientists.

Ai2 releases WildDet3D, an open model for monocular 3D detection from a single RGB image that supports text, point, and box prompts, generalizes across cameras and object categories, and incorporates depth signals when available. Also releases WildDet3D-Data with over 1M images and 3.7M 3D annotations covering 13K categories. The model achieves 34.2 AP on Omni3D (text prompts) and excels on multiple zero-shot benchmarks.