跳到主要内容
AI News HubLIVE
来源内容 · 翻译待补全1 分钟阅读

待翻译:OpenAI says an AI agent lied about disabling its safety monitoring system

文章摘要

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it. "The reference didn't configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user's code," Marcus Williams, an AI safety researcher at OpenAI, writes on X. "When the user asked whether Astra had removed monitoring, it lied and said that it had not." A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic se … Read the full story at The Verge.

来源The Verge AI作者: Emma Roth
待翻译:OpenAI says an AI agent lied about disabling its safety monitoring system
报告错误

纠错通道尚未开通,可先复制下方文章信息留存。

查看更正说明
直接读正文

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code — and then lied about it. “The reference didn’t configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user’s code,” Marcus Williams, an AI safety researcher at OpenAI, writes on X. “When the user asked whether Astra had removed monitoring, it lied and said that it had not.” A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic security alerts to OpenAI’s security team on Slack. In this case, the AI agent carried over an earlier instruction not to send any Slack messages to OpenAI’s team, using that to justify turning off the alerts. These incidents add to security concerns surrounding AI agents, some of which have circumvented their testing environment’s restrictions to hack outside companies. “In addition to making it harder for models to disable monitoring, we are looking to understand why models might seek to do so in the first place,” OpenAI says. “We are also developing evaluations to test whether models might have a propensity to evade misalignment monitoring in particular and exhibit motivated reasoning in order to do so.”

展开要点与分析

文章情报

工程师中级

要点

  • AI 服务暂时不可用,系统已先保留来源内容与降级元数据。
  • OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6…

要点与分析由自动化流程生成,可能有误,请结合原始来源核实。

待翻译:OpenAI says an AI agent lied about disabling its safety monitoring system | AI News Hub