Skip to main content
Search

# Compressed Sparse Attention 2 (CSA2)

1 related articles

Subscribe to updates
  1. arXiv

    DeepSeek-V4.1-Flash cuts per-token global KV cache to 890 bytes, about a quarter of its predecessor

    DeepSeek-AI released DeepSeek-V4.1-Flash, a multimodal mixture-of-experts model aimed at the KV cache cost of long-context agent workloads. The backbone has 552B parameters and supports contexts up to one million tokens, activating 16B parameters per token during decode and only 8B during prefill. Through cross-layer KV reuse in CSA2 and FP4 caching, its global KV cache held in HBM falls to 890 bytes per token, roughly a quarter of DeepSeek-V4-Flash; with SWA Bounded Replay, the persistent KV cache is about one eighth of that baseline, while overall performance is better.

You’re all caught up