Skip to content
AI News HubLIVE
More
Summary only

NVCF: Deploy and Route GPU-Accelerated AI Workloads at Scale

NVIDIA Cloud Functions (NVCF) is an open-source platform for deploying, managing, and running GPU-accelerated workloads at scale. It supports long-running functions and asynchronous tasks, leveraging Kubernetes for orchestration, and provides a unified control plane, load-balanced routing, multi-cluster autoscaling, and more. This article covers NVCF's architecture, workload types, core capabilities, and how to build with Bazel.

SourceHacker News AIAuthor: mastabadtomm
NVCF: Deploy and Route GPU-Accelerated AI Workloads at Scale
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions

Summary only

Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • NVCF is an open-source platform by NVIDIA for GPU workloads, supporting inference, streaming, and batch processing.
  • Architecture includes control plane, invocation plane, and compute plane, managed via Kubernetes.
  • Supports two workload types: functions (long-running) and tasks (batch), packaged as containers or Helm charts.
  • The project uses Bazel for building and provides a CLI tool for multi-cluster deployment.

Highlights and analysis are generated automatically and may contain errors. Check the original source.

More recent stories on this topic · Chips

NVCF: Deploy and Route GPU-Accelerated AI Workloads at Scale | AI News Hub