Jev-shaped (TypeSafe System One) classification wrapper over OpenAI-like clients - zhulinchng/jevper

11 points•czl_my•8 days ago•4 comments•
jevper is the Jev interface pointed at whatever model you already have.

4 comments

khimaros8 days ago
created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass https://github.com/khimaros/verdict
ljlolel8 days ago
we also have several jev type models available in seconds built on top of models on our router

mev (based on mercury) gemmev (based on gemma)

also these take images input

zev, lev etc

https://trustedrouter.com/docs/decide

jgilias8 days ago
But… why???
czl_my6 days ago
as an alternative option to Jev, and to take advantage of LLM's reasoning for the classification.

Read the full thread on Hacker News →

Related stories