Startup uses Arm cores and 128TB of LPDDR6 to smash AI's Memory Wall
Startup Majestic Labs has introduced the Prometheus server, which utilizes Arm-based AI processing units and large pools of LPDDR6 memory to challenge Nvidia's GPU-based architecture. The company claims this approach overcomes the 'memory wall' for AI inference more efficiently.
Why it matters
This represents a potential shift in AI hardware infrastructure, aiming to reduce costs and improve memory capacity for large-scale AI models.
AI startup claims cheap LPDDR6 memory can beat expensive HBM
When you purchase through links on our site, we may earn an affiliate commission. Here's how it works .
(Image credit: blocksandfiles) Copy link Facebook X Whatsapp Reddit Pinterest Flipboard Threads Email Share this article 0 Join the conversation Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Startup replaces Nvidia GPUs with custom Arm-powered AI processing hardware Prometheus packs up to 128TB of unified LPDDR6 memory onboard New server promises 1,000 more memory available per processor Majestic Labs, a startup founded in 2023 by former Google and Meta engineers, has unveiled a server built to rival Nvidia 's GPU and HBM combination.
The Tel Aviv-based company argues that pairing costly graphics processors with high-bandwidth memory has become a fundamentally memory-bound and dead-end approach for AI inference.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in