The AI safety bottleneck: Save the world or get the bag
AI safety researchers are increasingly leaving major tech firms to pursue independent research, citing concerns that corporate profit motives hinder necessary safety investments. The field is seeing a surge in demand as the potential existential risks of AI become a mainstream concern.
Why it matters
Highlights the tension between rapid AI commercialization and the critical need for robust safety and alignment protocols.
Getty Images; Tyler Le/BI When Rishub Jain worked on safety at Google DeepMind , he held one of the most coveted jobs in tech. He was among a small group of researchers working to mitigate the most consequential risks of AI. But he left to cofound a nonprofit, Sampura Research. Jain traded the prestige and access that come with a Google job because he feels he can have a sharper, more profound impact on AI safety from the outside. Jain says he wants the autonomy to pursue research on a specific issue in AI alignment, which he felt had been deprioritized. "All the top AI companies do care a lot about safety, and they invest in it, but they could be investing a lot more, and that's kind of what was inhibiting me," Jain says.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in