Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 - JustVugg/colibri

1 points•vforno•10 days ago•1 comment•

1 comment

vforno10 days ago
Hi everyone, I’m Vincenzo, the founder of Colibrì. Today, we are adding a new mode to Colibrì called "Brio," accessible via both the TUI and the web interface. We were all impressed by Jev and its potential, so I decided to create a mode that allows you to use any model supported by Colibrì—in both chat and Brio modes. Brio returns a probability for each choice and the entropy of that distribution. No output tokens are generated, but inference work still takes place: the engine processes the context and scores the provided option tokens. You can use it via the dashboard, the terminal, or the POST /v1/brio endpoint.

Read the full thread on Hacker News →

Related stories