跳到主要内容
AI News HubLIVE
站内改写2 分钟阅读

待翻译:OpenAI answers TypeSafe’s Jev with a Decision API built on Luna

文章摘要

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is The post OpenAI answers TypeSafe’s Jev with a Decision API built on Luna appeared first on The New Stack.

来源The New Stack AI作者: Frederic Lardinois
待翻译:OpenAI answers TypeSafe’s Jev with a Decision API built on Luna
报告错误

纠错通道尚未开通,可先复制下方文章信息留存。

查看更正说明
直接读正文

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is also announcing its take on this model type at its annual DevDay conference on Tuesday. The company’s new Decisions API is based on the company’s Luna model — the smallest and most affordable model in its current lineup. Limited preview The Decisions API is likely a reaction to TypeSafe and Jev, and OpenAI probably rushed the announcement ahead of its DevDay, so for now, this is all OpenAI is sharing about the Decisions API. An OpenAI spokesperson tells The New Stack that the company plans to share more “at broad rollout.” For now, the new API is available in limited preview, and the broad release is planned for the coming days. Predefined answers, real confidence scores The core idea behind these decision models is that they are explicitly not chat models; instead, they return a set of predefined answers with confidence scores. Regular LLMs are not always very good at this. Their confidence scores, after all, are often a rough guess — and they burn quite a few tokens to get there. This makes this kind of model ideal for classifying content, routing requests, or choosing an agent’s next action from a limited set of choices. Decision models, however, can provide more realistic confidence scores, and they tend to return them extremely fast. OpenAI says its model returns results in 150 milliseconds, compared to GPT-6 Luna, which would take 1.6 seconds. All the developer has to do is provide the questions, answers, and context. Prompts vs. small classifiers Today, most teams handle this today with a regular chat model and a carefully worded prompt, asking it to pick from a list and, if they’re lucky, reading the token probabilities to get something that resembles a confidence score. The alternative is to train a small classifier. That is fast and cheap but needs labeled data and a retraining run every time the label set changes. A decision model basically sits between those two options. It takes new labels in the prompt but returns a score a developer can work with. This isn’t a completely new concept for OpenAI. Its Moderation API has long returned per-category scores instead of prose, too, though in this API, the categories are pre-set by OpenAI, not the developer. What’s still unclear is what the Decision API costs per call, how many candidate answers a single request can handle, and whether developers can tune it on their own data. Those details will decide whether this becomes a standard building block in agent frameworks or stays a niche tool next to the chat models. The post OpenAI answers TypeSafe’s Jev with a Decision API built on Luna appeared first on The New Stack.

展开要点与分析

文章情报

工程师中级

要点

  • AI 服务暂时不可用,系统已先保留来源内容与降级元数据。
  • With the sudden rise of TypeSafe’s Jev, decision models have become incredibly popular, so it’s not surprising that OpenAI is The post OpenAI answers TypeSafe’s Jev with a Decisio…

要点与分析由自动化流程生成,可能有误,请结合原始来源核实。