Article may be outdated

This article is 45 days old. Some details may have changed since publication.

Hacker News·3 min read·hard

Show HN: Jevper – the Jev interface on top of any OpenAI-compatible model

C
czl_my
Show HN: Jevper – the Jev interface on top of any OpenAI-compatible model
✦AI Summary

Jevper is a new open-source interface that allows developers to use the Jev structured output format with any OpenAI-compatible LLM. It functions independently of TypeSafe AI and supports various backends like llama.cpp.

Why it matters

It provides developers with more flexibility and vendor-neutral options for implementing structured data extraction from large language models.

✦Dive DeeperCreate a free account to unlock

The Jev interface — state in, typed questions ( noul , choice , score ) out, answers carrying probabilities and confidence — on top of any OpenAI-compatible model.

Same call as typesafe-sdk , different backend: point jevper at a hosted LLM or a self-hosted llama.cpp server and code written for Jev keeps working, unchanged.

It does not call the hosted TypeSafe API and does not depend on typesafe-sdk or openai at runtime — the client object is duck-typed. Any object exposing responses.create or chat.completions.create works, including a self-hosted llama.cpp server.

jevper is an independent implementation of the documented System One wire format. It is not affiliated with, endorsed by, or supported by TypeSafe AI — questions about the API itself belong in their docs .

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologyai
✦

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in