Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 - JustVugg/colibri
1 comment
vforno10 days ago
Hi everyone, I’m Vincenzo, the founder of Colibrì. Today, we are adding a new mode to Colibrì called "Brio," accessible via both the TUI and the web interface. We were all impressed by Jev and its potential, so I decided to create a mode that allows you to use any model supported by Colibrì—in both chat and Brio modes. Brio returns a probability for each choice and the entropy of that distribution. No output tokens are generated, but inference work still takes place: the engine processes the context and scores the provided option tokens. You can use it via the dashboard, the terminal, or the POST /v1/brio endpoint.
Read the full thread on Hacker News →
Related stories
- Hacker News · 1 points · 9 days ago
- AI Mode for Emacsgithub.comHacker News · 1 points · 9 days ago
- Hacker News · 1 points · 9 days ago
- Hacker News · 1 points · 9 days ago
- Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fieldsderkleineli.github.ioHacker News · 1 points · 10 days ago
- Generating levels in real time with the Jev modelspritefusion.comHacker News · 2 points · 11 days ago