Measured serving frontier · 0.85 operating point
Gemma-4-26B-A4B-IT · G7
Point details
Hover a point to inspect the stack. Click to pin it.
Precision, parallelism, KV precision, batching, backend, and speculation will appear here.
Blue points form the efficient envelope; the dashed gray curve is default vLLM. Point details use the actual serving stack rather than optimization numbers.
Figure 1, throughput versus tail latency. The efficient envelope changes with the model and hardware.