跳到主要内容
AI News HubLIVE
来源内容 · 翻译待补全3 分钟阅读

待翻译:The platform for inference, training, and execution | Baseten

文章摘要

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:The platform for inference, training, and execution | Baseten Please rotate your device To continue exploring this website, please rotate your device to a vertical orientation Product Introducing Serverless Loops: front…

待翻译:The platform for inference, training, and execution | Baseten
报告错误

纠错通道尚未开通,可先复制下方文章信息留存。

查看更正说明
直接读正文

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

The platform for inference, training, and execution | Baseten Please rotate your device To continue exploring this website, please rotate your device to a vertical orientation Product Introducing Serverless Loops: frontier RL training for everyone Loops is now generally available. Post-train on frontier open models and deploy directly to Baseten Dedicated Inference. Authors Date November 6, 2026 Today, Serverless Loops is generally available. Loops is a training SDK for supervised fine-tuning (SFT) and reinforcement learning (RL) on frontier open models, with a direct path to production. Train through a familiar Tinker-compatible API, evaluate your checkpoints, and deploy the resulting model to Baseten Dedicated Inference. With the API, you focus on the training signal rather than worrying about all the finicky details of building and operating a robust, large-scale training backend. We take care of the GPUs, the kernels, the model architectures, as well as the performance and numerical correctness of the distributed training infrastructure. As part of our initial launch, you will have access to a selection of popular open-weight models for post-training at a 256k context length for both SFT and RL. We have a competitive per-token billing model (see full details below), so you only pay for what you use. Production-ready models One of our simplest and favorite features of Serverless Loops is that you can deploy trained models straight onto Baseten’s production inference platform with a single click! Baseten loads your adapter alongside its base model and creates a production endpoint on the same Baseten Inference Stack that serves 15B+ inference requests per day with full autoscaling, deployment management, and inference metrics. You don’t have to do that, of course, as you have full access to download your weights in the standard Hugging Face Safetensors format. For this GA release, we’ve also improved how Loops handles transient network errors and GPU failures, reduced startup overhead, and accelerated weight transfers between trainers and samplers. These improvements let us support more concurrent workloads for our customers. Model support RL results We validate Serverless Loops with end-to-end RL experiments alongside our numerical tests. We train with tasks from τ-bench across retail, airline, and banking domains and evaluate on a set of held-out hard tasks: Customers Teams at NVIDIA, Datadog, LangChain Labs, and Ambience Healthcare have already been using Loops: NVIDIA post-trained their own Nemotron Super 3.5 VL model to see how it learns across text and vision—from intent classification and receipt extraction to RL for visual object counting. The post-trained model improved intent classification accuracy from 76.8% to 94% and achieved 87% validation F1 on receipt extraction. Datadog tests new training ideas for their SRE agent on frontier open models using multi-turn agentic RL. LangChain Labs post-trains custom models on agent traces to solve difficult tasks in LangSmith Engine, such as reading a GitHub repository to diagnose why an issue is happening, then drafting the prompt or code change that goes into the PR. Ambience Healthcare post-trained models to handle the nuances of clinical language, from correcting transcription errors to accurately capturing medical terminology and formatting. Run your first experiment To get started: Create a Baseten API key. Follow the Loops quickstart to create your first run. Bring your dataset or use the reinforcement learning guide to connect your reward function. Adapt an example from the Loops cookbook that fits your agent’s runtime and sandbox needs. If you prefer dedicated throughput, request dedicated capacity. If you’re bringing your own training stack, explore Baseten Training Jobs for managed GPU infrastructure or RL Rollouts for scalable rollouts with your own trainer. Looking forward We’ve also got a lot of exciting features lined up: new models, quantization techniques, score centering, and more! We’ll be releasing a series of technical write-ups explaining how we tackled some of the trickier problems in our training code and infrastructure. Look out for explainers on how we find kernel bugs, how we select the LoRA targets for our trainer, and how we made the MoE LoRA kernels in our inference engine over 4x faster. We'll also be sharing details on how we've optimized cross-cluster weight syncs and how we make decisions to balance efficiency and raw speed in our trainer and sampler. We’re excited to see what you create with Loops.

展开要点与分析

文章情报

工程师进阶

要点

  • AI 服务暂时不可用,系统已先保留来源内容与降级元数据。
  • The platform for inference, training, and execution | Baseten Please rotate your device To continue exploring this website, please rotate your device to a vertical orientation Pro…

要点与分析由自动化流程生成,可能有误,请结合原始来源核实。

待翻译:The platform for inference, training, and execution | Baseten | AI News Hub