跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全3 分鐘閱讀

待翻譯:Z.ai’s GLM-5.3 Flash is cheap, good, and served on Chinese chips

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:Ox-alpha, the stealth model that quickly became the most popular model on OpenRouter in the last few days, is actually The post Z.ai’s GLM-5.3 Flash is cheap, good, and served on Chinese chips appeared first on The New Stack.

來源The New Stack AI作者: Frederic Lardinois
待翻譯:Z.ai’s GLM-5.3 Flash is cheap, good, and served on Chinese chips
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

Ox-alpha, the stealth model that quickly became the most popular model on OpenRouter in the last few days, is actually Z.ai’s GLM-5.3 Flash, a 320 billion-parameter hybrid model (with 18 billion active parameters) that the team specifically trained for ultra-low-cost inference. On Wednesday, Z.ai unmasked the stealth model and made its weights available on Hugging Face under the MIT license. It’s also already available on a number of inference platforms, including OpenRouter, where it’s currently available at $0.075 per million input tokens and $0.25 per million output tokens (though those prices reflect a 50% discount). Benchmarks: It’s good, but not Fable While some of the early hype put the model at the level of Anthropic’s Claude Fable 5, the benchmarks don’t bear this out. But the model can, for the most part, keep up with a Claude Opus 4.8 and OpenAI’s GPT-5.6 Terra when set to its max-effort reasoning mode. On the Artificial Analysis Intelligence Index, GLM-5.3 Flash sits at 57 points, in line with GPT-5.6 Terra, Google’s Gemini 3.7 Flash, Meta’s Muse Spark 1.2, and Qwen 3.8 2.4T A95B. When it comes to its performance in driving AI agents, which may be a better indication of how it will perform in real-world use cases, it’s doing even better than its competitors. The model is able to understand multimodal inputs, including images, videos, and files. Z.ai also stresses that it trained the model to do better at visual tasks like building presentations and websites, as well as at standard knowledge work tasks like working with documents, spreadsheets, and dashboards, all of which also benefit from the model’s improved visual capabilities. Credit: Z.ai. One caveat: the model is very chatty and burns a lot of tokens, which isn’t unusual for smaller models that need more reasoning steps to achieve this kind of performance. Because the inference costs are so low, though, that’s not too much of an issue. Cheap inference on Chinese chips None of these competing models comes close to matching Z.ai’s pricing, and that may just be the most important takeaway from this launch. These Chinese open-weight models — including those from Alibaba, Deepseek, and Moonshot (Kimi) — are getting closer and closer to the performance of what American frontier labs can achieve — and they are making them available at a very low cost (and for free for those who have the hardware to run them). Credit: Z.ai. One fact that tripped many early ox-alpha users up was the fact that the lab behind the model was able to serve 100 trillion free tokens per day (according to OpenCode). Very few infrastructure providers can handle that. But as it turns out, Z.ai did all of this on Chinese AI chips, something the company heavily stresses in its announcement. “Compared with our initial baseline on the same hardware, we achieved a 3× improvement in end-to-end serving performance, reaching hardware efficiency and per-token cost comparable to mainstream NVIDIA GPUs,” Z.ai writes. “This demonstrates that Chinese chips can support frontier-model inference efficiently and economically at scale.” Credit: Z.ai. Linear and sparse attention The company doesn’t go into details, but notes that the individual chips are limited in compute and memory capacity. But Z.ai built its own inference engine based on SGLang for this serving stack — with the help of its flagship GLM-5.3 model powering an infrastructure agent, which the company says created “a feedback loop in which the model helped optimize the system serving the model itself.” Z.ai doesn’t say what chips the model was trained on, but the company does note that it was trained on a 30 trillion multimodal pre-training corpus and that the team used a hybrid architecture that combines linear and sparse attention. Credit: Z.ai. “Linear attention captures local dependencies through state modeling, while sparse attention retrieves relevant global context through a lightweight indexer,” the team explains, and also notes that compared to the full GLM 5.3 model, GLM 5.3 Flash’s architecture reduces the compute by 3x and KV cache size by 4.4x. The model has a context window of 1 million tokens, so those reduced KV cache sizes make a substantial difference. For developers, the calculus here is pretty straightforward. A model that matches Opus 4.8 on the benchmarks that matter for agents, at a tenth of the price, is hard to ignore. For the U.S. labs, the harder question is what happens now that Chinese labs can serve at this scale. The post Z.ai’s GLM-5.3 Flash is cheap, good, and served on Chinese chips appeared first on The New Stack.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • Ox-alpha, the stealth model that quickly became the most popular model on OpenRouter in the last few days, is actually The post Z.ai’s GLM-5.3 Flash is cheap, good, and served on…

技術影響

可能影響 GPU、推理集羣、算力成本和供應鏈規劃。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。