Skip to content
AI News HubLIVE
In-site rewrite1 min read

Is regulation enough to stop AI systems killing us all? | Letters

Summary

In a letter, Martyn Thomas asks how any rational person can claim that independent oversight and regulation will be sufficient, after yet another frontier AI model was withdrawn for failing safety tests. He notes that safety-critical software such as aircraft and nuclear power controls has long been governed by international standards requiring rigorous "safety cases".

SourceThe Guardian AIAuthor: Guardian Staff
Is regulation enough to stop AI systems killing us all? | Letters
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

Martyn Thomas wonders how any rational person can argue that independent oversight and regulation will be sufficient

Once again a frontier AI model has been withdrawn because it fails safety tests (OpenAI scraps release of new model over safety concerns in internal testing, 28 September). There is the usual call for “independent oversight and regulation”, though never any explanation of how this would work or, most importantly, what evidence should persuade a regulator that an AI system is adequately safe.

There is a long engineering tradition of regulating safety-critical software systems, such as those controlling aircraft or nuclear power stations; international standards require “safety cases” – rigorous analyses that show that the possible hazards have been identified and controlled and that the probability of an accident is extremely low.

Continue reading...

Key points and analysis

Article intelligence

EngineersIntermediate

Key points

  • Another frontier AI model was withdrawn after failing safety tests (OpenAI scrapped a release over internal testing concerns, 28 September).
  • The letter argues the familiar call for "independent oversight and regulation" never explains how it would work.
  • It asks what evidence should persuade a regulator that an AI system is adequately safe.
  • Aircraft and nuclear power software are regulated through international standards requiring rigorous "safety cases".

Highlights and analysis are generated automatically and may contain errors. Check the original source.

More recent stories on this topic · Policy