Skip to content
AI News HubLIVE
More
Summary only

Microsoft researchers find AI models and agents can't handle long-running tasks

Microsoft researchers have found that even the priciest frontier models introduce errors in long workflows, with an average of 25% document content loss over 20 interactions. Their DELEGATE-52 benchmark across 52 domains showed only Python programming met the 98% readiness threshold. Agentic tools often made performance worse.

SourceHacker News AIAuthor: beardyw
Microsoft researchers find AI models and agents can't handle long-running tasks
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions

Summary only

Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • LLMs lose on average 25-50% of document content over 20 delegated interactions.
  • Only Python programming domain scored 'ready' in the DELEGATE-52 benchmark.
  • Using tools (agentic harness) did not improve performance; it added 6% average degradation.
  • Catastrophic corruption (score ≤80%) occurred in over 80% of model/domain combinations.

Highlights and analysis are generated automatically and may contain errors. Check the original source.