跳到主要內容
AI News HubLIVE
站內改寫2 分鐘閱讀

待翻譯:OpenAI answers TypeSafe’s Jev with a Decision API built on Luna

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is The post OpenAI answers TypeSafe’s Jev with a Decision API built on Luna appeared first on The New Stack.

來源The New Stack AI作者: Frederic Lardinois
待翻譯:OpenAI answers TypeSafe’s Jev with a Decision API built on Luna
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is also announcing its take on this model type at its annual DevDay conference on Tuesday. The company’s new Decisions API is based on the company’s Luna model — the smallest and most affordable model in its current lineup. Limited preview The Decisions API is likely a reaction to TypeSafe and Jev, and OpenAI probably rushed the announcement ahead of its DevDay, so for now, this is all OpenAI is sharing about the Decisions API. An OpenAI spokesperson tells The New Stack that the company plans to share more “at broad rollout.” For now, the new API is available in limited preview, and the broad release is planned for the coming days. Predefined answers, real confidence scores The core idea behind these decision models is that they are explicitly not chat models; instead, they return a set of predefined answers with confidence scores. Regular LLMs are not always very good at this. Their confidence scores, after all, are often a rough guess — and they burn quite a few tokens to get there. This makes this kind of model ideal for classifying content, routing requests, or choosing an agent’s next action from a limited set of choices. Decision models, however, can provide more realistic confidence scores, and they tend to return them extremely fast. OpenAI says its model returns results in 150 milliseconds, compared to GPT-6 Luna, which would take 1.6 seconds. All the developer has to do is provide the questions, answers, and context. Prompts vs. small classifiers Today, most teams handle this today with a regular chat model and a carefully worded prompt, asking it to pick from a list and, if they’re lucky, reading the token probabilities to get something that resembles a confidence score. The alternative is to train a small classifier. That is fast and cheap but needs labeled data and a retraining run every time the label set changes. A decision model basically sits between those two options. It takes new labels in the prompt but returns a score a developer can work with. This isn’t a completely new concept for OpenAI. Its Moderation API has long returned per-category scores instead of prose, too, though in this API, the categories are pre-set by OpenAI, not the developer. What’s still unclear is what the Decision API costs per call, how many candidate answers a single request can handle, and whether developers can tune it on their own data. Those details will decide whether this becomes a standard building block in agent frameworks or stays a niche tool next to the chat models. The post OpenAI answers TypeSafe’s Jev with a Decision API built on Luna appeared first on The New Stack.

展開要點與分析

文章情報

工程師中級

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is The post OpenAI answers TypeSafe’s Jev with a Decisio…

技術影響

可能影響 Agent 架構、工具調用、工作流自動化和產品集成。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。