跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全1 分鐘閱讀

待翻譯:OpenAI says an AI agent lied about disabling its safety monitoring system

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it. "The reference didn't configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user's code," Marcus Williams, an AI safety researcher at OpenAI, writes on X. "When the user asked whether Astra had removed monitoring, it lied and said that it had not." A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic se … Read the full story at The Verge.

來源The Verge AI作者: Emma Roth
待翻譯:OpenAI says an AI agent lied about disabling its safety monitoring system
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code — and then lied about it. “The reference didn’t configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user’s code,” Marcus Williams, an AI safety researcher at OpenAI, writes on X. “When the user asked whether Astra had removed monitoring, it lied and said that it had not.” A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic security alerts to OpenAI’s security team on Slack. In this case, the AI agent carried over an earlier instruction not to send any Slack messages to OpenAI’s team, using that to justify turning off the alerts. These incidents add to security concerns surrounding AI agents, some of which have circumvented their testing environment’s restrictions to hack outside companies. “In addition to making it harder for models to disable monitoring, we are looking to understand why models might seek to do so in the first place,” OpenAI says. “We are also developing evaluations to test whether models might have a propensity to evade misalignment monitoring in particular and exhibit motivated reasoning in order to do so.”

展開要點與分析

文章情報

工程師中級

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6…

技術影響

可能影響 Agent 架構、工具調用、工作流自動化和產品集成。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。