Hacker News·3 min read·hard

Show HN: Mini-AGI – Dynamic continual learning model trained on 8GB VRAM

V
volotat
Show HN: Mini-AGI – Dynamic continual learning model trained on 8GB VRAM
AI Summary

Mini-AGI is an experimental byte-level language model designed to perform continual learning on consumer-grade hardware with 8GB of VRAM. The project aims to demonstrate that models can learn from new data streams without 'catastrophic forgetting' by managing weights on disk.

Why it matters

This project challenges the current paradigm of static, massive-scale AI models by exploring efficient, decentralized training methods for individual users.

Dive DeeperCreate a free account to unlock

mini-AGI - is a continual learning byte-level language model that assembles its own architecture, trains from scratch on a single 8 GB VRAM GPU, and keeps learning from everything it reads. It stores its weights as ordinary files on disk and pages them onto the card as it needs them, so the parameter count is bounded by free disk space rather than by VRAM. It grows new capacity while training when it runs short, prunes what nothing asks for, and reads through exactly the same code path it serves on. Targeted at a PC or laptop with at least an 8 GB VRAM GPU on the board.

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologyai

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in