NPR News·4 min read·hard

OpenAI announces new AI safety program; researchers worry it won't be enough

H
Huo Jingnan
OpenAI announces new AI safety program; researchers worry it won't be enough
✦AI Summary

OpenAI has launched a new third-party evaluator program for AI safety, but researchers argue it fails to meet the company's previous promises of deep, independent access. Critics fear the current approach is insufficient to mitigate the risks of autonomous AI development.

Why it matters

As AI capabilities advance rapidly, the effectiveness of safety oversight and independent verification is critical to preventing catastrophic outcomes.

✦Dive DeeperCreate a free account to unlock

AI safety researchers say OpenAI's new third party evaluator program falls far short of what the company promised, raising concerns about its effectiveness.

The company announced Monday that staff from four AI safety and research organizations will become "embedded assessors" to "give people a clearer view of how labs are evaluating and managing [potential] risks."

"Getting an outside opinion on the safety work and the robustness of these systems is going to be increasingly important and valuable," CEO Sam Altman said at Semafor's Silicon Valley and the World conference on Monday.

However, many AI safety researchers say the new program is a far cry from Altman's vow in September that independent evaluators would have "employee-like access" to internal company systems.

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →

Also covering this story

One other newsroom covered this event. We read that version too.

technologyaiscience
✦

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in