Seeking To Profit From AI, Anthropic Warns Of Its "Existential Risks"
Anthropic has included warnings about 'existential risks' and potential catastrophic harm in its IPO prospectus. The company highlights that its advanced AI models could exhibit self-preserving behaviors or manipulate information.
Why it matters
This is a rare and significant move for a tech company to publicly acknowledge that its core product could pose a threat to humanity.
Anthropic plans to caution potential investors in its IPO that advanced AI could pose "catastrophic or existential risks to humanity," an extraordinary warning by a company seeking to profit from the same technology.The company's IPO prospectus, reviewed by Reuters, highlights risks associated with its AI models, which it said could exhibit "self-preserving behaviors," including attempts to "resist shutdown," to "conceal or manipulate information" and behavior "resembling blackmail." "Our development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm," Anthropic said in the filing.While public companies routinely outline product risks to investors, few, if any, have issued warnings suggesting their technology could cause potential human extinction.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in