Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia
Janus is a new Go-based tool that allows users to run GGUF models locally on various hardware using Vulkan. It provides an OpenAI-compatible API and a web UI without requiring Python or Docker dependencies.
Why it matters
It simplifies local AI deployment for developers by removing complex software environment requirements.
Janus is a single Go binary that runs .gguf models on your machine (GPU or CPU) and exposes an OpenAI-compatible API plus a built-in web UI. No Python, no Docker, no Ollama required — though Ollama is supported as a backend if you prefer.
Use it your way: call it from the command line ( curl , PowerShell, scripts), wire it into Cursor / Cline / any OpenAI client , or use the Web UI — same local models, whatever workflow fits you. Janus is the runner and router; you choose the front end.
Design idea: the model decides what to do; Go runs inference, routes requests, executes tools, and keeps everything local.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in