LLMs and Self-Referentiality
The author explores the emergence of self-referential capabilities in large language models, noting that these traits appear as a byproduct of training rather than explicit programming. The piece challenges historical philosophical arguments that self-reference is a unique barrier to artificial intelligence.
Why it matters
It provides a contemporary perspective on the philosophy of mind and the evolution of AI capabilities, questioning long-held academic theories about machine intelligence.
I woke up yesterday with the following thoughts, which are probably either obvious or dumb.
A central thesis that many readers, including me, took from Douglas Hofstadter’s Gödel Escher Bach when young was that the secret of intelligence (and therefore, of AI) was going to have a lot to do with self-referentiality and “strange loops.”
Even Roger Penrose’s The Emperor’s New Mind , which in some ways was the anti-GEB, ironically agreed with GEB about the fundamental importance of self-reference to the success or failure of the whole AI project. It claimed (incorrectly, in my view and in most experts’) that AI could never work because there was something about Gödel’s Theorem and self-reference that no computer program could ever capture, but that could be captured by exotic physics accessible to the human brain.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in