Anthropic pitches AI safety bill that may block a model if 50+ people could be killed

AI lab Anthropic has drafted a proposed AI safety bill to circulate among members of Congress. The legislation recommends blocking the release of AI models if they pose an imminent, foreseeable risk of causing over 50 deaths or a billion dollars in property damage through biological weapons, cyberattacks, or control evasion.
Why it matters
As AI capabilities grow, proactive industry proposals for federal regulation shape the future compliance framework and safety standards for the entire tech sector.
Over the past year, concerns have swirled over the potential dangers posed by artificial intelligence, and debates have raged over the proper path for AI safety. Now, Anthropic appears to have put forth its own vision for how the government might regulate its industry.
Politico recently reported that the AI lab has been shopping around a new draft bill on AI safety that it hopes Congress might consider adopting. The legislation posits certain scenarios in which the release of an AI model could be blocked from distribution.
Those scenarios involve a “foreseeable, imminent risk” — one in which over 50 people are at risk of dying or if over a billion dollars in property damage could result, Politico writes. The catastrophic risk in question must “stem from the creation or release of a biological weapon, the model evading its developer’s controls or a cyberattack,” the outlet notes.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in