Claude’s new model is more ‘honest’ when it messes up
Anthropic is releasing Claude Opus 4.8 on Thursday, touting the model's 'honesty.' Early testers found it more likely to flag uncertainties and less likely to make unsupported claims. Evaluations show it is about 4x less likely than its predecessor to allow code flaws to pass unremarked. Users can also direct the amount of effort Claude puts into a task, and a 'dynamic workflows' feature allows parallel subagents.
Article intelligence
Key points
- Claude Opus 4.8 is more inclined to flag uncertainties and avoid unsupported claims.
- It is about 4x less likely than its predecessor to overlook code flaws.
- Users can control the effort level Claude applies to a task to manage token usage.
- A new 'dynamic workflows' feature enables parallel execution of hundreds of subagents.
Why it matters
This matters because claude Opus 4.8 is more inclined to flag uncertainties and avoid unsupported claims.
Technical impact
May affect model selection, inference cost, product capability, and evaluation benchmarks.
Anthropic is releasing Claude Opus 4.8 on Thursday, and the company is touting the model’s “honesty.” According to Anthropic, it trains “all [its] models to be honest — for instance, to avoid making claims that they can’t support.” But it notes that “a general problem with AI models is that they sometimes jump to conclusions, confidently presenting their work as making progress despite thin evidence.” The AI lab claims that early testers have found that Opus 4.8 “is more likely to flag uncertainties about its work and less likely to make unsupported claims.” In the company’s evaluations, Opus 4.8 is “around 4x less likely than its predecessor to allow flaws in code it’s written to pass unremarked.” In addition to the honesty improvements, with Opus 4.8, users can direct the amount of effort Claude puts into a task. Higher-effort responses will use more tokens, giving users the option of lower-effort responses if they don’t want to burn through their rate limits as quickly. Anthropic is also launching a feature called “dynamic workflows” in research preview, which the company says will let Claude “take on even bigger tasks.” With dynamic workflows, “Claude can plan the work and then run hundreds of parallel subagents in a single session (and with Opus 4.8, the agents can run for even longer). It then verifies its outputs before reporting back to the user.”