LangChain releases four new test environments to benchmark LLMs' ability to use tools effectively, covering function calling, planning, and reasoning. Tests include single-tool and multi-tool typewriter tasks, relational data queries, and a math task with altered rules. Key findings: GPT-4 excels on relational data but fails on longer trajectories; Claude 2.1 matches GPT-4 on three tasks; open-source models like Mistral 7b struggle with multi-step function composition; planning remains challenging for all models.

Compare GPT-4, Claude, and open-source LLMs on structured data extraction from chat logs. Benchmark results, evaluation metrics, and dataset creation insights.

Anthropic launches Claude Science, an AI workbench for life sciences researchers, integrated with Modal to provide elastic compute infrastructure for running data processing, structure prediction, and molecule design directly from a conversation.

Eight papers from Together AI accepted to ICML 2026, covering the full AI stack from agents to GPU kernels. These research works are integrated into the Together platform and already benefit production workloads.

Every Eval Ever (EEE) and Hugging Face Community Evals are now intercompatible, allowing cross-posting and interpretation of evaluation results with links to open models, leaderboards, and a unified standardized metadata store.