Skip to main content
Search

# KSA V2

1 related articles

Subscribe to updates
  1. arXiv

    Kwai's KSA V2 reuses summary tokens twice: 40.4% smaller resident cache at 128K, with prefill throughput above the original hybrid

    Kwai retrofitted pretrained hybrid KSA models into KSA V2, letting each layer's existing summary tokens serve both as re-compressible distant memory and as a block-level sparse index. On the 1.9B (MHA) backbone at 128K, resident cache falls from 10.59 GiB to 6.31 GiB, a 40.4% reduction, and prefill reaches 44,971 tokens/s versus 29,837 for the original hybrid KSA. The six-length RULER mean is 72.39% against 72.61%, and the 128K score is 65.01% against 65.35%.

You’re all caught up