Anthropic Update on Independent Evaluators
Anthropic has announced a new initiative to allow independent third-party organizations, such as METR, to evaluate its frontier AI models for safety and risk. This move aims to increase public accountability while protecting commercially sensitive information.
Why it matters
As AI models become more powerful, establishing robust, independent oversight frameworks is critical to mitigating potential societal risks.
Last month, we committed to stronger independent, third-party assessment of our models and safety practices. We also signed the White House Accord on Super Intelligence, in which companies pledged to partner with independent external auditors or evaluators. Today, we’re announcing that we’ve started to give employee-like access to a team from METR , a nonprofit that evaluates frontier AI models.
METR will publish the results of its risk assessments. Over the past year, we’ve worked with METR on several reviews of our Risk Reports . We’re also working with SecureBio and Accenture as evaluators, and are in early discussions with several other organizations, including Hugging Face .
Here, we explain our approach to working with evaluators.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in