Skip to content
AI News HubLIVE
More
Summary only

A 429 from a quota cap and a 429 from rate-limit need different cooldowns

resilient-llm-router is a Python library for multi-provider LLM routing that distinguishes between quota and rate-limit 429 errors by tracking three orthogonal states per (provider, model, credential): rate-limit, quota, and circuit health, preventing unnecessary retries.

SourceHacker News AIAuthor: eleion_ai
A 429 from a quota cap and a 429 from rate-limit need different cooldowns
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions

Summary only

Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Distinguishes between two types of 429 errors: transient rate limits and exhausted quotas, requiring different cooldown strategies.
  • Supports three backends: in-memory, SQLite, and PostgreSQL for persistence and multi-host deployments.
  • Optional probe daemon and auto-detection of rate-limit headers.

Highlights and analysis are generated automatically and may contain errors. Check the original source.