Hacker News·3 min read
ESP32S3 cluster running 1.58-bit (BitNet) Language model
N
nkko
A distributed pipeline inference engine on multiple ESP32S3 running 1.58-bit (BitNet) Language model.
This project runs a sliced 0.5B LLM across a cluster of 7 ESP32s3. One act as master and others are node. The master node runs the tokenizer and embeding and the other attention layer and MLP ran on the nodes. The master and node communicate through high speed SPI Daisy-Chain.
✦
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in