Anthropic’s IPO pitch includes a warning about human extinction
AI startup Anthropic has included warnings about existential risks, including potential human extinction, in its IPO prospectus. The company is seeking a valuation exceeding $2 trillion while acknowledging the massive infrastructure costs required to sustain its growth.
Why it matters
The inclusion of existential risk in a financial filing underscores the unprecedented safety concerns surrounding advanced AI development.
let’s all stop and take a deep breath Anthropic’s IPO pitch includes a warning about human extinction The Claude maker warns its own models could resist shutdowns and cause catastrophic harm.
22 Credit: SOPA Images/Getty Credit: SOPA Images/Getty Text settings Story text Size Small Standard Large Width * Standard Wide Links Standard Orange * Subscribers only Learn more Minimize to nav Anthropic has formally warned investors that its technology may pose “existential risks to humanity” in a long-awaited initial public offering prospectus circulated with a small group of partners in recent days.
The nearly $1 trillion AI start-up led by Dario Amodei devoted almost a third of its lengthy S-1 filing to detailing “risk factors,” including the potential of increasingly advanced AI models to manipulate, blackmail and exhibit other unpredictable behaviors.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in