Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console
A new project allows users to run large language models natively on a jailbroken PlayStation 5 using the llama.cpp framework. The console acts as a private, local server for AI models, providing API access to other devices on the network without needing cloud connectivity.
Why it matters
This demonstrates the repurposing of consumer gaming hardware for high-performance local AI inference, bypassing traditional cloud-based AI services.
Your PS5 runs the language model. Every device on your network uses it. llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.
New: decision models, powered by Ollaya . PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the same /v1/systemone API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.
PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC while it runs, no cloud and no account.
Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.
Home, Models, Console, API and Settings on the TV.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in