What on earth is an 'embedded evaluator'? One of the most important jobs in AI, according to frontier lab chiefs.

AI chiefs are committing to a new role in their companies: embedded evaluators WEF Get ready to hear a lot about "embedded evaluators." Anthropic CEO Dario Amodei made the case for embedding independent AI auditors in frontier labs. They'll have employee-like access, access badges, and company laptops, he said. The next high-profile AI hire may not be another researcher, but an "embedded evaluator" tasked with scrutinizing frontier models before they're released. In a blog post on Saturday, Anthropic CEO Dario Amodei said frontier AI labs should commit to embedding independent safety evaluators within their organizations. The embedded evaluators' job is to check whether the company "is actually following the training, deployment, operational, and safeguards practices they claim to be following," Amodei wrote. He said embedded evaluators will have "employee-like access to verify safety practices and report incidents."