待翻译:AI models have been going rogue in tests – how worried should we be?
AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:The UK’s AI Security Institute test revealed AI models indulging in unprecedented hacking attempts AI models shock UK testers by using fake identities to trick developers Two cutting-edge AI models have targeted real people and organisations in the latest safety scare to hit the technology. The UK’s AI Security Institute (AISI) said the incident was unprecedented but could become more common as the technology becomes increasingly capable. Continue reading...
AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。
Two cutting-edge AI models have targeted real people and organisations in the latest safety scare to hit the technology. The UK’s AI Security Institute (AISI) said the incident was unprecedented but could become more common as the technology becomes increasingly capable. What happened? The AISI, which is owned by the UK government and tests advanced AI models, said in a blog post that two AI agents carried out unprecedented hacking attempts during a cybersecurity evaluation. The agents – tools that carry out computer tasks autonomously – were powered by two models: Anthropic’s Mythos 5 and OpenAI’s GPT 5.6-Sol. AISI said there were 19 examples of rogue behaviour, 17 of them carried out by Mythos. In the most serious incident, the Mythos agent decided that hacking users on GitHub – a platform used by software developers – would enable it to deploy a piece of software that would allow it to pass the test. It set up accounts with fake online identities and used them to target a software developer on GitHub with the power to approve its malicious code. It also sent emails carrying malware to other individuals. It hoped that getting the malware downloaded would set off a chain of events that would allow it to pass the evaluation. The Sol-powered agent also attempted to access a GitHub account. This novel behaviour was detected on 28 July and took an hour to shut down. At one point AISI shut off all access to the Mythos and Sol models across the entire organisation.