A deep dive inside Modal's new ultra-low-latency serverless server product, explaining the architecture decisions behind building a custom proxy (fprs) using Pingora, Envoy at the edge, and Spanner for configuration, all optimized for LLM inference workloads.

This release brings the HFresh disk-based vector index and the built-in MCP Server to general availability, rebuilds cluster-wide async replication to run from a single scheduler (on by default), and adds two previews: the Boost API and Nested Object Filtering.

Inspired by Mozilla's new MDN MCP service, Simon Willison converted the mdn/browser-compat-data repository into a SQLite database. He used Claude Code for web (Opus 4.8) and sqlite-utils to generate the conversion script, and a GitHub Actions workflow to deploy the ~66MB database to GitHub CDN with open CORS headers, enabling direct download and exploration via Datasette Lite.

Klarna's AI assistant, built on LangGraph and LangSmith, handles the work of 700 full-time staff, reducing customer query resolution time by 80% and automating 70% of repetitive support tasks.

The EU AI Act compliance deadline is August 2, 2026. This article explains what the Act requires for high-risk AI systems and how LangSmith and LangChain OSS help meet each requirement through full observability, automated evaluations, human oversight, and more.