Anthropic wants users to be nicer to Claude. Here's what smart people are saying about its move to ban abusive behavior.
Anthropic has introduced a policy to ban sustained, cruel abuse toward its AI model, Claude, sparking debate over the ethics of human-AI interaction. While some view it as a sensible precaution for training safer models, others warn against anthropomorphizing machines.
Why it matters
This policy reflects a growing industry trend of setting behavioral norms for AI interaction, raising questions about the boundary between human empathy and machine utility.
Anthropic's ban on abuse toward Claude is igniting a fight over whether AI deserves moral concern. Kevin Dietsch/Getty Images Anthropic will begin treating sustained, needless abuse of Claude as a policy violation. Some say the rule could train safer AI; others say it blurs the line between machines and people. "Granting them human-like empathy is one of the most dangerous things we could do," one tech CEO said. If you've ever told Claude it should be fired into the sun for botching a spreadsheet, Anthropic would like a word. The AI frontier lab said that, starting November 12, it will treat "sustained and needless abusive or cruel behavior" toward its models as a violation of its usage policy. Anthropic says its policy is designed to prevent real-world harm and promote responsible use of its products.
Also covering this story
6 other newsrooms covered this event. We read each version separately.
Anthropic bans ‘abusive or cruel behavior’ towards Claude
Anthropic Bans "Cruel" Behavior Against Its Claude AI
Anthropic updates Claude policy, may ‘ban’ users who are abusive or cruel to its AI
Anthropic is updating its usage policy to ban abusive behavior toward Claude
Anthropic changes usage policy to ban model abuse and election interference
Anthropic bans users from being 'cruel' to its AI systems
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in