AscMLA lets FP4 caches feed MLA decoding directly: one shared payload for K and V, 1.35x faster than TRT-LLM's FP8 kernel
Long-context decoding repeatedly rereads a growing KV cache, and FP4 can shrink that storage, but block scaling clashes with MLA's shared latent: existing routes either dequantize first or encode K and V separately. AscMLA keeps one FP4 payload for both K and V and gives them different scales, one per 16-channel block for K and one per token for V, folding the V scale into the softmax probability. Across forty configurations it reaches geometric-mean decode speedups of 1.35 over TRT-LLM's FP8 kernel and 1.26 over CAKE's NVFP4 MLA kernel, with 38.2% less KV cache memory than FP8.