AI’s recursive self-improvement might not come so quickly after all

A new study from researchers at Princeton suggests that AI agents currently lack the creativity and judgment required for genuine, open-ended scientific research. While AI can handle narrow engineering tasks, the study indicates that recursive self-improvement remains further away than current industry hype suggests.
Why it matters
This research challenges the prevailing narrative of imminent, autonomous AI breakthroughs, suggesting that human-like research capabilities are not yet within reach.
AI agents are not yet creative enough to carry out genuinely innovative open-ended AI research, it seems.
The AI industry’s boldest promise right now is that AI will soon improve itself, with almost no need for human oversight. LLMs can already write code, generate synthetic data for training, and optimize the computer chips they run on. Forecasts of explosive AI progress predict that what researchers call recursive self-improvement is on the horizon.
But a new study suggests that it might take a while for us to get there. The researchers behind it found that AI agents are not yet capable of conducting open-ended AI research—free-form investigations that have no clear-cut answers and require judgment and taste, which may be integral to building self-improving AI.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in