Skip to content
AI News HubLIVE
More
Summary only

Redis Creator Builds a Dedicated Inference Engine for DeepSeek V4: ds4.c

Salvatore Sanfilippo (antirez), the creator of Redis, has open-sourced ds4.c, a lightweight inference engine tailored for DeepSeek V4 Flash. It runs efficiently on Apple Silicon Macs using Metal API, achieving up to 27 tokens/s generation on high-end models.

Source量子位Author: henry
Redis Creator Builds a Dedicated Inference Engine for DeepSeek V4: ds4.c
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions

Summary only

Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Antirez releases ds4.c, a Metal-only inference engine for DeepSeek V4 Flash, optimized for Mac. No other models supported.
  • Employs asymmetric quantization (2-bit for MoE expert layers, Q8 for others) and disk-based KV caching for speed.
  • Built-in OpenAI and Anthropic API compatibility enables easy integration with coding agents like Claude Code.
  • Project sparks debate on model-specific frameworks; antirez advocates for full-stack local inference as a product.

Highlights and analysis are generated automatically and may contain errors. Check the original source.

More recent stories on this topic · Models