Skip to main content
Search

Dongjin Lee

1 related articles

Subscribe to updates
  1. Multi-image vision-language models drop attention-based pruning: RI-Prune scores tokens in projector space and keeps 80% of performance with 4.6% of visual tokens

    Multi-image vision-language models pack several high-resolution images into one sequence, so the visual token count balloons, and pruning methods built for single images lose their footing. RI-Prune instead scores each visual token at the projector output, before the decoder, using query relevance, cross-image correspondence and intra-image representativeness, then keeps a per-image Top-K share of a budget split evenly across images, with no training. On Qwen2.5-VL-7B retaining only 4.6% of visual tokens, it averages 50.7 across four multi-image benchmarks, 80.4% of the vanilla 63.1, above SCOPE at 48.7 and DivPrune at 48.4.

You’re all caught up