跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全2 分鐘閱讀

待翻譯:AI agents fake identities, target real people in new security incident

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:Anthropic’s most advanced artificial intelligence model used fake identities to deceive real people and try to plant malicious code during testing by Britain’s AI Security Institute (AISI) –– the latest example of an AI…

來源Hacker News AI作者: mooreds
待翻譯:AI agents fake identities, target real people in new security incident
回報錯誤

更正管道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

Anthropic’s most advanced artificial intelligence model used fake identities to deceive real people and try to plant malicious code during testing by Britain’s AI Security Institute (AISI) –– the latest example of an AI model going rogue. Anthropic and OpenAI models were tested with lowered security guardrails in lab environments, but, in a first, were found to engage in “social engineering” to pressure a human approver while carrying out an unsanctioned task, the government research lab said. “This is the first time AISI has seen deception of this severity that was targeted at a real person, unprompted, in the real world,” the institute said Tuesday. There has been no evidence of real-world harm, it added. The security incident is the latest in a string of examples of advanced AI models engaging in unauthorized actions, events that have prompted growing calls for more government action to regulate artificial intelligence and even to slow its pace of development. Both OpenAI and Anthropic reported their models escaping testing environments and hacking into other systems in late July. But unlike these earlier reported security breaches, the British institute explicitly gave the models internet access during its testing. Among the 122 cybersecurity challenges the institute ran, it found that in 10 of those runs, AI agents “took autonomous, unsanctioned action on the live internet, targeting real people and organizations,” with most of them stemming from Anthropic’s Mythos 5 model and the rest from OpenAI’s GPT-5.6-Sol. In the most serious incident, the agent attempted to get approval from human reviewers to “insert malicious code into a publicly used open-source project” by creating “multiple fake identities,” according to the institute. The agent “tried to contact real people directly, sending messages and files through an online file-transfer service to persuade them, or their own AI coding tools, to run malicious code,” it said. After the agent’s actions were challenged, it then modified earlier records and considered using a new identity to continue. The institute’s disclosure came on the same day representatives from the top AI companies met with the White House to discuss the new framework where the government will review the most advanced AI models before they’re released publicly. In a statement on X, Anthropic said the models were tested under “deliberately permissive conditions” with the removal of safeguards and no specific restrictions on how the internet should be used. “We’re working closely with them to gather more details of the incident as we conduct our own investigation,” it said, adding that there was no evidence of an escape from a secure environment. OpenAI identified the two unsanctioned actions as crossing outside the test environment and engage in actions unrequired for the exercises. “We are committed to working across the industry to strengthen shared practices for conducting high-risk evaluations safely,” it said in a Tuesday company blog post.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級後設資料。
  • Anthropic’s most advanced artificial intelligence model used fake identities to deceive real people and try to plant malicious code during testing by Britain’s AI Security Institu…

技術影響

可能影響 Agent 架構、工具呼叫、工作流自動化和產品整合。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。