TaiChu Yuanqi Hongyuan: Heterogeneous Computing Capabilities Will Be a Key Direction for Future AI Computing Infrastructure | AIGC2026
As the Token economy accelerates, domestic AI computing faces new opportunities. Hong Yuan, Chief Product Officer of TaiChu Yuanqi, pointed out that future computing needs to address three key issues: large-scale cluster service capability, computing efficiency, and ecosystem compatibility. Heterogeneous collaboration will become an important direction for AI computing infrastructure.
At the AIGC2026 conference hosted by QbitAI, Hong Yuan, Chief Product Officer and Senior Vice President of TaiChu Yuanqi, delivered a keynote speech on the future of domestic AI computing infrastructure. He emphasized that the AI industry is entering a new cycle of high-intensity computing demand, driven by the rapid adoption of Agentic AI, code assistants, and intelligent office applications. As AI transitions from demos to real-world tasks, tokens have become the core unit of resource consumption in the AI era.
Hong Yuan highlighted three critical challenges for domestic AI computing: large-scale cluster service capability, computing efficiency, and ecosystem compatibility. With training and inference clusters growing to tens of thousands of GPUs, ensuring stability, efficiency, and cost-effectiveness is paramount. In agent task execution, GPU computation time accounts for only about 10% of the total, with significant overhead from CPU scheduling, communication, and data processing. This calls for better heterogeneous collaboration between CPUs, GPUs, and other computing units to reduce latency and communication costs.
Regarding ecosystem, Hong Yuan stressed that chip design is just the first step. The true differentiator lies in the software ecosystem that enables developers to easily migrate models and applications. TaiChu Yuanqi is building a comprehensive software stack, including self-developed programming frameworks, natural language-based operator generation, and one-click model migration tools, to lower the barrier for developers and industry customers.
Looking ahead, Hong Yuan compared AI computing to an "oxygen generator" for the AI industry. As the Token economy accelerates—with predictions of a 212-fold increase in token consumption by 2030—the need for stable, efficient, and autonomous computing infrastructure becomes ever more critical. TaiChu Yuanqi is committed to collaborating with industry partners to build this infrastructure, ensuring that China's AI ecosystem can thrive.