Oxford-Cambridge researchers flag ChatGPT's 'big problem'; Michael Burry agrees
Researchers from Oxford and Cambridge have identified 'model collapse,' a phenomenon where AI models trained on synthetic data lose their ability to generate unique or nuanced content. Investor Michael Burry has endorsed these findings, warning that AI systems may struggle with self-correction and propagation errors.
Why it matters
This research highlights a potential existential bottleneck for the scalability and quality of future generative AI systems.
Researchers at Oxford and Cambridge have identified a fundamental flaw threatening the future of large language models like ChatGPT, and "Big Short" investor Michael Burry says the finding backs up a warning he's been making about the technology's core limitations for a while. A new study from the University of Oxford and University of Cambridge has revealed a major threat to large language models like ChatGPT, calling it “model collapse.” The research shows that when generative AI systems are repeatedly trained on synthetic data produced by earlier models, they begin to lose the “tails” of the original data distribution.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in