tpu
3 stories and discussions about tpu, aggregated from every source we track.
1.
Running a Jev-Style Decision Model on One TPU v6e: What Fits, What It Costs, and What Changes From a GPUdev.to
Gemma 4 E2B, E4B, 12B and a 26B-A4B fp8 build read by their label probabilities with vLLM on one TPU v6e chip, checked against the same read on an NVIDIA L4 and against Jev 1.13.0's published results. What fits one chip, how to read labels when vLLM on TPU returns only the top 32 log-probabilities, speed, cost, and why no 31B loads today.
2.
How our Kimi K3 megakernel on TPU v7 reaches over 700 tokens/s with speculative decoding and nearly 2× GB200's batch-one decode throughput.
3.