Sarvam Token Factory opens in India: one inference stack returns GLM 5.3 Flash's first token up to 2.1× sooner
Sarvam launched Token Factory, an inference stack running on GPU clusters in India that serves its own Sarvam 105B alongside open-weight models such as GLM 5.3, DeepSeek V4.1 Flash, Kimi K3.1 Pro and Gemma 4 31B through one OpenAI-compatible API. Long agent prompts previously survived in GPU memory for only about 4 seconds, so returning turns were almost always re-prefilled; Token Factory splits prefill from decode and adds a three-tier cache with cache-aware routing. On GLM 5.3 Flash with AgentX coding-agent traces, first token arrives up to 2.1× sooner than stock vLLM and Dynamo on the same two B200 nodes, with a 667 ms median against 1,428 ms at 64 concurrent sessions.