Multi-image vision-language models drop attention-based pruning: RI-Prune scores tokens in projector space and keeps 80% of performance with 4.6% of visual tokens
Multi-image vision-language models pack several high-resolution images into one sequence, so the visual token count balloons, and pruning methods built for single images lose their footing. RI-Prune instead scores each visual token at the projector output, before the decoder, using query relevance, cross-image correspondence and intra-image representativeness, then keeps a per-image Top-K share of a budget split evenly across images, with no training. On Qwen2.5-VL-7B retaining only 4.6% of visual tokens, it averages 50.7 across four multi-image benchmarks, 80.4% of the vanilla 63.1, above SCOPE at 48.7 and DivPrune at 48.4.