MicroLLM lab - tiny LLMs, Q4, in your browser

Lobsters·1 points·dimonomid·1 day ago·stateofutopia.com

Run Q4 small language models entirely in the browser with WebGPU. Chat, benchmark, and compare PetitGPT, SmolLM2, and friends on-device.

Read the full article at stateofutopia.com →

Related stories

Related topics