NVIDIA introduces Nemotron-Labs Diffusion language models that achieve up to 6.4x faster inference than autoregressive models while maintaining high accuracy by generating tokens in parallel and refining them iteratively. The models support three modes: autoregressive, diffusion, and self-speculation. The 8B model outperforms Qwen3 8B by 1.2% accuracy.

Databricks now supports automatic prompt caching for open-source LLMs, reducing latency and boosting throughput without any configuration. In production, GPT-OSS models saw 2.5x throughput improvement and 3x P50 latency reduction. The feature works across batch, pay-per-token, and provisioned workloads for multiple open-source models.

Databricks now supports writing OpenTelemetry traces directly to Unity Catalog tables via a fully managed, serverless ingestion path, enabling governed, analytics-ready observability data with long-term retention and unified evaluation workflows.

A recap of the 2026 I/O Dialogues, where leaders discuss the future of AI, quantum computing, robotics and creativity.

GitHub Copilot now serves 140,000 organizations, with over 100% year-over-year growth. Gartner positions GitHub as a Leader for the third consecutive year, highest in ability to execute.