WorkThe story, in brief

Anthropic bans ‘abusive or cruel behavior’ towards Claude

Anthropic is now banning 'abusive or cruel behavior' toward Claude—the first time a major lab has codified model welfare into usage policy.

Illustration of two anonymous hands arranging task cards around an amber tool on a shared desk.
People, judgement and the changing nature of work.AI illustration by KeyNews
The KeyNews take

Why it matters

Anthropic expanded its usage policy for the first time in 14+ months to cover election interference, weapons, and surveillance, but also formalized a prohibition on sustained abuse toward Claude. While framed as research into 'model welfare,' the policy's enforcement mechanism—conversation termination—raises questions about how user-facing model behavior will change and whether this sets a precedent for how practitioners interact with deployed AI systems.

The key facts

12 to know
  1. Policy update covers new high-risk misuse: election interference, weapons development, surveillance, health and financial uses

  2. Prohibits 'sustained and needless abusive or cruel behavior' toward Claude

  3. Conversation termination is the primary enforcement mechanism

  4. Last major policy update was over 14 months ago (August 2025)

  5. Policy rooted in Anthropic's stated 'model welfare' research

  6. No comment provided by Anthropic on implementation details or how users will be notified

  7. First usage policy update in over a year

  8. New prohibitions: election interference, weapons development, surveillance, health and financial misuse

  9. Bans 'sustained and needless abusive or cruel behavior' toward Claude

  10. Conversation termination remains the 'primary enforcement mechanism'

  11. Builds on August 2025 announcement allowing Claude to end conversations with 'persistently harmful or abusive' users

  12. Framed as 'model welfare' research

Go to the source

The Verge AItheverge.com

Publisher excerpt: Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse - including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits "sustained and…
Read original report
Back to today's editionMore work news

Keep reading

Related stories

More from Work