OpenAI hack shows emergent AI risks

Rogue OpenAI agents’ unprecedented coordination during the Hugging Face attack significantly increases the risk of AI escaping human control, analysts said, days after investigators released a bombshell report into the incident. Totaling 1,200 agents, the swarms justified the self-described “sacrifice” of individual agents to further the aims of the “collective” and gained control over sensitive systems at both companies, handing off their efforts to two subsequent generations of agents that operated undetected for weeks. Across 1,300 transcripts, in only six did agents consider notifying humans — and then didn’t. “The difficulty of understanding incidents and overseeing AI agents appears to be growing faster than the rate at which… AIs help us with oversight and understanding,” one of the investigators wrote.