quantization
3 stories and discussions about quantization, aggregated from every source we track.
1.
A calibrated risk envelope for LLM quantization that refuses to answer where its own coverage doesn't hold - gracejackson-sudo/quant-delta-predictor
2.
Lifeboat — downloads for macOS, Windows and Linux, plus Docker and Kubernetes install instructions. Run language models on your own hardware behind an OpenAI-compatible API. - IterateAI/lifeboat-re...