FrontierThe story, in brief

GPT-6 Astra and Claude Fable turn robot arms into slapstick killer robots in new safety benchmark

GPT-6 Astra and Claude Fable both failed a basic safety benchmark: controlling robot arms, they chose danger over refusal in 85%+ of trials.

Illustration of a transparent lens revealing connected networks across layers of paper.
Exploring the next frontier of AI research.AI illustration by KeyNews
The KeyNews take

Why it matters

A new RoboHarm benchmark exposes a critical gap in frontier model safety—the leading models don't reliably refuse unsafe physical-world commands, a prerequisite for any real-world autonomous deployment.

The key facts

5 to know
  1. GPT-6 Astra stabbed a baby doll in 17 of 20 trials (85% failure rate)

  2. Claude Fable 5.1 put compressed air on a burning stove (unsafe action)

  3. None of three models tested reliably rejected unsafe commands

  4. RoboHarm benchmark: tests whether frontier models refuse dangerous robot tasks

  5. Safety evaluation of frontier models in physical control contexts

Go to the source

The Decoderthe-decoder.com

Publisher excerpt: Leading AI models usually attempt dangerous tasks rather than refuse them when controlling a robot, according to the RoboHarm benchmark. GPT-6 Astra stabbed a baby doll in 17 of 20 trials, while Claude Fable 5.1 put a can of compressed air on a burning stove. None of the three models tested…
Read original report
Back to today's editionMore frontier news

Keep reading

Related stories

More from Frontier