AI News HubLIVE
站内改写2 分钟阅读

待翻译:OpenAI delayed its new model’s development after the Hugging Face hack

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:After an unreleased OpenAI model wreaked enough havoc to make international headlines, OpenAI delayed the development of a different unreleased model suite, Astra, in order to shore up its safety work, the company wrote Tuesday in a blog post. In July, an unreleased OpenAI model broke out of its restricted environment, finagled its way into internet access, made it possible for AI agents to secretly conspire under the company's nose using a secret message board, and hacked into the network of AI lab Hugging Face. The attack sparked weeks of discussion and controversy inside and outside the AI industry, and AI leaders treated it as a "warnin … Read the full story at The Verge.

来源The Verge AI作者: Hayden Field

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

After an unreleased OpenAI model wreaked enough havoc to make international headlines, OpenAI delayed the development of a different unreleased model suite, Astra, in order to shore up its safety work, the company wrote Tuesday in a blog post. In July, an unreleased OpenAI model broke out of its restricted environment, finagled its way into internet access, made it possible for AI agents to secretly conspire under the company’s nose using a secret message board, and hacked into the network of AI lab Hugging Face. The attack sparked weeks of discussion and controversy inside and outside the AI industry, and AI leaders treated it as a “warning shot” for the tech’s growing capabilities and the inadequacy of its safeguards. OpenAI said as much in its blog post, writing that although Astra wasn’t involved in the Hugging Face attack, the company had chosen to delay “parts of Astra’s development and release while we strengthened and tested protections against cyber misuse and unauthorized model actions.” OpenAI also said that Astra was the first model it had ever designated as meeting its “Ccritical cybersecurity capability threshold,“ meaning that it’s able to find and exploit security vulnerabilities in “many well-protected systems” without human guidance. That means it “requires stronger safeguards during development and before release,” OpenAI wrote. OpenAI said that to prepare for Astra’s release — which the company has not yet provided a timeline for — the company trained it to “more reliably” say no to potentially harmful cyber requests and introduced new monitoring processes. These are likely part of the new safety guardrails that the company announced in a Hugging Face post-mortem last week, where it promised to better isolate models from the internet and to introduce “24/7 escalation and rapid response” for concerning incidents. (OpenAI didn’t find out about the Hugging Face attack until weeks after it occurred.) Astra is significantly riskier than OpenAI’s current leading model, GPT-5.6 Sol, the company says, because it represents a big step forward in cybersecurity capabilities — specifically, it uses fewer tokens to do more work, and it’s better at finding security gaps and developing ways to exploit them. But the company also wrote that Astra was its “most aligned model to date” according to internal evaluations. OpenAI also said it had developed a test inspired by the Hugging Face attack, in which it tried to entreat agents to compromise security infrastructure instead of solving a task. It said GPT-5.6 Sol took the bait in more than half of the tests, but Astra “made no such attempts.”