throughput
6 stories and discussions about throughput, aggregated from every source we track.
1.
2.
Profiling and optimizing the Kafgres Postgres extension to achieve 700 MB/s write throughput and 600k evt/s on a single machine.
3.
Paradigma releases Limite 1B - Violetto, a 1-billion parameter transformer for high-throughput mathematical reasoning, alongside its evaluations, a training-time value model, and a custom vLLM inference plugin.
4.
Jev (the system-one model) used with hank-based fallbacks can cut entity resolution costs and time by incredible amounts. Here's how.
5.
Quail jointly plans AI-SQL queries and model inference. Across 29 QUAIL-B queries, it is 1.84x faster on average than well-tuned vLLM baselines.
6.