Show HN: Mini-AGI – Dynamic continual learning model trained on 8GB VRAM
Mini-AGI is an experimental byte-level language model designed to perform continual learning on consumer-grade hardware with 8GB of VRAM. The project aims to demonstrate that models can learn from new data streams without 'catastrophic forgetting' by managing weights on disk.
Why it matters
This project challenges the current paradigm of static, massive-scale AI models by exploring efficient, decentralized training methods for individual users.
mini-AGI - is a continual learning byte-level language model that assembles its own architecture, trains from scratch on a single 8 GB VRAM GPU, and keeps learning from everything it reads. It stores its weights as ordinary files on disk and pages them onto the card as it needs them, so the parameter count is bounded by free disk space rather than by VRAM. It grows new capacity while training when it runs short, prunes what nothing asks for, and reads through exactly the same code path it serves on. Targeted at a PC or laptop with at least an 8 GB VRAM GPU on the board.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in