How to build a Jev-style classifier with DiffusionGemma and vLLM

How to build a Jev-style classifier with DiffusionGemma and vLLM medium.com

1 points•teleforce•3 days ago•2 comments•

#diffusiongemma #style #vllm #classifier #jev #jev style #style classifier #jev style classifier

2 comments

The OP article didn't mentioned it, but there's LocalJev based on DiffusionGemma depends on unmerged vLLM [1].

[1] A local, Jev-compatible POST /v1/systemone API written in TypeScript for Bun, backed by DiffusionGemma through an OpenAI-compatible Chat Completions endpoint.

https://github.com/githubnext/localjev

verdverm3 days ago

The article points at the PR which has been merged into vLLM, this should come out in the next vLLM release. Same author has another PR to improve speed by ~25% iirc (they are testing on GB10)

Read the full thread on Hacker News →

2 comments

Related stories