跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全2 分鐘閱讀

待翻譯:More than 1 in 10 chance AI ‘could kill all humans,’ says Anthropic safety lead after colleague quits

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:A senior Anthropic safety researcher has said there is more than a 10 percent chance artificial intelligence "could kill all humans" by the end of the decade, just hours after a colleague resigned over fears the AI lab and its rivals are carelessly racing to build "superhuman systems" they cannot control. In a post on X announcing his departure, Jacob Coxon, a researcher who has trained AI systems at Anthropic, said he had quit the company over its lax approach to safety. Coxon, who previously trained systems for OpenAI, accused the two AI companies of "racing straight to self-improving superintelligence and gambling with our lives," even … Read the full story at The Verge.

來源The Verge AI作者: Robert Hart
待翻譯:More than 1 in 10 chance AI ‘could kill all humans,’ says Anthropic safety lead after colleague quits
回報錯誤

更正管道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

A senior Anthropic safety researcher has said there is more than a 10 percent chance artificial intelligence “could kill all humans” by the end of the decade, just hours after a colleague resigned over fears the AI lab and its rivals are carelessly racing to build “superhuman systems” they cannot control. In a post on X announcing his departure, Jacob Coxon, a researcher who has trained AI systems at Anthropic, said he had quit the company over its lax approach to safety. Coxon, who previously trained systems for OpenAI, accused the two AI companies of “racing straight to self-improving superintelligence and gambling with our lives,” even though “the people building AI earnestly believe that it could kill us all by the end of the decade.” Industry insiders have long expressed concerns about the potential dangers of self-improving AI systems, which they warn could spiral out of human control in a runaway loop often described as recursive self-improvement. While not yet realized, companies are actively pursuing this goal and much of today’s AI code is written with the help of AI. In a direct response, Evan Hubinger, who leads one of Anthropic’s AI safety teams, said he worries about self-improving AI, adding that it “is happening faster than we thought.” He also agreed with Coxon’s characterization. “We really do earnestly believe AI could kill all humans,” he said, personally estimating the chances to be greater than one in 10 “within the next decade.” Despite this, Hubinger said Anthropic does “not yet have a plan” for ensuring advanced AI remains safe and aligned with human values and “are not clearly on track to” develop one either. Coxon says the companies are “locked in a race” to develop advanced systems first so are pushing ahead “despite the risk.” Coxon’s departure marks one of the most high profile examples of an employee leaving Anthropic, a company founded by former OpenAI members following concerns over safety at the company. In recent years, multiple researchers have cited safety concerns as motivating their decision to leave OpenAI. The exchange illustrates mounting concerns within the industry about the dangers of increasingly sophisticated AI models and the speed at which systems are being developed, particularly as the companies prepare for anticipated IPOs. It also comes as the companies manage the fallout from numerous rogue agent incidents and high-profile safety warnings about the monitorability of frontier models.

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級後設資料。
  • A senior Anthropic safety researcher has said there is more than a 10 percent chance artificial intelligence "could kill all humans" by the end of the decade, just hours after a c…

技術影響

可能影響 Agent 架構、工具呼叫、工作流自動化和產品整合。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。