Will it take a ‘Chernobyl-scale disaster’ for us to regulate cyber weapons of mass destruction? | Stuart Russell
Unrestrained development of unsafe AI systems is leading to intolerable risks. Stuart Russell warns that recent signs of recursive self-improvement at Anthropic could lead to an intelligence explosion and calls for regulation before it's too late.
Unrestrained development of unsafe AI systems is leading to intolerable risks
Stuart Russell is a computer scientist known for his contributions to AI and a new Guardian US columnist
The AI company Anthropic has been making major headlines recently. Its trillion-dollar IPO plan and its blood feud with secretary of defense Pete Hegseth have attracted much attention, but two other events may be even more consequential.
In early June, the company posted an article describing early signs of recursive self-improvement (RSI), a process in which an AI system devises ways to increase its own intelligence, leading to a greater ability to improve itself, and so on.
Stuart Russell is a distinguished professor of computer science at University of California, Berkeley, the president of the International Association for Safe and Ethical Artificial Intelligence and a Guardian US columnist
Continue reading...