Wired·5 min read·medium

These AI Experts Want to Do High-Stakes Research Out in the Open

W
Will Knight
These AI Experts Want to Do High-Stakes Research Out in the Open
✦AI Summary

Trillium Labs, a new nonprofit, is advocating for open-source AI research to counter the secrecy of major frontier labs. The founders argue that transparency is essential for scientific scrutiny and risk mitigation in powerful AI development.

Why it matters

It addresses the growing tension between AI safety through restricted access versus safety through open scientific collaboration.

✦Dive DeeperCreate a free account to unlock

Nathan Lambert and Tom Zick, two industry scientists, believe the opposite. The pair founded a nonprofit, Trillium Labs, that will work on various areas of AI research—including potentially problematic areas like recursive self-improvement (RSI) and agents—in a more transparent way. In practice, this will mean publishing the details of experiments so that outside scientists can study and replicate them.

Lambert says the way frontier AI labs keep their work secret reduces the community’s ability to scrutinize ideas and contribute new approaches. He believes that letting outside experts see how models are built and tuned could be crucial to mitigating risks.

“Over the past few millennia, humanity has had the scientific method in our toolbox as a way to mitigate harms and build better futures,” Lambert tells WIRED. “The current closed trajectory of frontier AI development is taking us a step backwards.”

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologyscience
✦

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in