Early Anthropic hire, former METR COO have found a way to rein in rogue AI agents
Startup AIUC has raised $40 million to develop a cybersecurity-style audit and certification standard for AI agents. The company aims to help enterprises manage risks associated with increasingly autonomous AI systems.
Why it matters
As AI agents become more capable, establishing standardized safety and control frameworks is critical for enterprise adoption and risk mitigation.
A day after Anthropic researcher Jacob Coxon quit his job over concerns that AI could kill us all by the end of the decade, I met with founders and brothers-in-law Rune Kvist and Rajiv Dattani. They think they have a solution that could save us all, or at least help prevent AI agents from going rogue inside enterprises.
“AI is getting smarter at an increasingly rapid rate. The surprising thing about AI is that it becomes harder to adopt and harder to control as AI gets smarter, not easier,” said Kvist, an early Anthropic employee who is also married to Dattani’s sister). Dattani is the former COO of the AI safety research organization METR.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in