ZML releases free product to speed inference across AI chips
ZML, a French AI startup endorsed by Turing Award winner Yann LeCun, has released free inference software enabling various open-source LLMs to run on multiple chips including Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc.
The days of Nvidia’s unparalleled market dominance aren’t over, but challengers and choices are arising from all directions.
ZML, a hot French AI startup endorsed by Turing Award winner Yann LeCun, has released inference-performance software that allows a variety of open-source large language models to run on a variety of chips — including Nvidia’s, AMD’s, Google’s TPU, Apple Metal and Intel Arc.