Tech Articles
Curated developer articles, tutorials, and guides – auto-updated hourly
xbill12h ago • 10 min read
Deploying a QAT Checkpoint Your Serving Stack Can't Load: Gemma 4 E2B in Pure JAX on One TPU
vLLM on TPU cannot load the Gemma 4 E2B QAT exports. So I served them from a hand-rolled JAX engine ...
#tpu#jax#llm#quantization
2 0