Hacker News·4 min read

Ollaya – Ollama for open-source, Jev-style decision models

A
Ardakilic
Ollaya – Ollama for open-source, Jev-style decision models
✦Dive DeeperCreate a free account to unlock

Ask typed questions about any text or JSON and get calibrated answers in milliseconds. Private, open source, on your own hardware.

Download Browse models ollaya · zsh $ ollaya run laya --preset triage \ "I was charged twice this month and want a refund." Answers returned by the model Question Answer Probability intent refund 1.00 is_urgent no 0.87 frustration 1.59 / 3 clearly annoyed 0.36 refund_requested yes 0.88 churn_risk no 0.89 $ Real output: routed to laya:en , answered in 8.9 ms on an RTX 4090. Fast Drop-in compatible Open models Your data stays yours Platforms Fast Decisions in milliseconds.

A decision model answers in a single forward pass, with no token-by-token generation. On your own GPU, a five-question request to Laya takes about 10 ms, end to end through the HTTP API.

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
✦

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in