2-bit KV caches get more than a rotation: RoLaQ calibrates quantization range too, topping six benchmarks on three MLA models
Multi-head latent attention (MLA) compresses each token's key-value cache into one shared latent, and at two bits an error in that latent perturbs both attention matching and value readout. RoLaQ refines a shared rotation within subspaces defined by the frozen key and value projections, and jointly learns quantization thresholds whose reconstruction gains are coupled to control the shared signal's response. Across DeepSeek-V2-Lite, Moonlight-16B-A3B and MiniCPM3-4B on six benchmarks, it reaches the highest average accuracy among the compared 2-bit methods both without and with token protection; without protection it beats the strongest baseline by 1.1 to 3.8 points.