'Reckless' AI firms can't control models, says whistleblower Jacob Coxon
Whistleblower Jacob Coxon testified before the New York City Council that leading AI firms are acting recklessly by prioritizing speed over safety. He warned that current development paths could lead to a loss of human control over AI systems.
Why it matters
Adds to the growing public and legislative debate regarding the existential risks posed by advanced AI and the need for regulatory oversight.
Leading artificial intelligence companies do not know how to keep AI systems from pursuing objectives their developers did not assign, whistleblower Jacob Coxon, a former OpenAI and Anthropic employee, warned Monday.
"Companies are being extremely reckless given the stakes," Coxon told local lawmakers at a hearing before the New York City Council.
In early September, the British researcher published a statement on X explaining his decision to resign from Anthropic, saying AI developers sincerely believed the technology could "kill us all by the end of the decade."
His testimony made headlines around the world, and several current and former employees of AI's major players have since voiced similar concerns.
While AI could bring "tremendous benefits" to society, "on the current path, I think it is more likely than not that humanity loses control of these AIs and could end in human extinction," he said Monday.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in