Show HN: DeepSeek V3 in ~200 lines of pure Jax
A developer has released a 200-line implementation of the DeepSeek-V3 architecture using pure JAX. The project demonstrates key model features like Multi-head Latent Attention and DeepSeekMoE on consumer hardware.
Why it matters
It provides an accessible, readable reference for understanding complex modern LLM architectures without the overhead of heavy frameworks.
The architecture from the DeepSeek-V3 technical report in 190 lines of pure JAX , pretrained from scratch on a MacBook Air on public-domain detective fiction.
No Flax, no Equinox, no PyTorch. Params are plain dicts of arrays and every part of the model is a function you can read top to bottom in deepseek_v3.py .
Read the write-up: DeepSeek V3 in 190 lines of pure JAX , with diagrams, the code explained piece by piece, and the results.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in