Skip to main content
Search

Jingyuan Zhang

1 related articles

Subscribe to updates
  1. arXiv

    Pruned visual tokens keep the answer but shift the odds: DiFiT trains selection on the full model's response distribution

    Visual token pruning for multimodal large language models is usually judged by whether answers stay correct, yet pruning can change the probabilities of alternative responses even when greedy answers do not move. DiFiT learns which visual tokens to keep from both the full-token model's response distributions and reference answers, with one ranking serving several retention ratios. On Qwen2.5-VL-7B it cuts sampling-induced negative flips by 30.3% relative to FastV at 10% retention and preserves 98.74% of baseline performance on MME at 30% retention.

You’re all caught up