DeepSeek-V4.1-Flash cuts per-token global KV cache to 890 bytes, about a quarter of its predecessor
DeepSeek-AI released DeepSeek-V4.1-Flash, a multimodal mixture-of-experts model aimed at the KV cache cost of long-context agent workloads. The backbone has 552B parameters and supports contexts up to one million tokens, activating 16B parameters per token during decode and only 8B during prefill. Through cross-layer KV reuse in CSA2 and FP4 caching, its global KV cache held in HBM falls to 890 bytes per token, roughly a quarter of DeepSeek-V4-Flash; with SWA Bounded Replay, the persistent KV cache is about one eighth of that baseline, while overall performance is better.