跳到主要內容
AI News HubLIVE
更多
來源內容 · 翻譯待補全1 分鐘閱讀

待翻譯:Modal Clusters are generally available

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:Multi-node GPU clusters with RDMA, gang scheduled from Modal's shared capacity pool and billed by the second, behind a single decorator.

來源Modal Blog作者: Peyton Walters
待翻譯:Modal Clusters are generally available
回報錯誤

更正管道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

Organizations need to own their intelligence to be successful. Training and serving that intelligence at scale, however, requires petaFLOP/s of compute and terabit/s of networking, spread across many nodes. But owning intelligence doesn’t need to mean owning that hardware. For the past 1.5 years, we’ve been battle-testing a new primitive: Modal Clusters. Today, we’re excited to announce that they are generally available through a single decorator, @modal.clustered: @app.function(gpu="B300:8") @modal.clustered(size=4, rdma=True) def train_model(): cluster = modal.Cluster.from_context() container_ips = cluster.private_ips() container_rank = cluster.container_rank() world_size = len(container_ips) main_addr = container_ips[0] print(f"{container_rank=} {world_size=} {main_addr=}") ...

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級後設資料。
  • Multi-node GPU clusters with RDMA, gang scheduled from Modal's shared capacity pool and billed by the second, behind a single decorator.

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。