Keeping only 5% of visual tokens still holds 91.6% of performance: Glance-ETD glances at low resolution, then selects tokens by question evidence
In multimodal large models, visual tokens dominate prefill cost for high-resolution images, and earlier pruning at extreme budgets only shortened the language model's input while the vision encoder still attended over every patch. Glance-ETD uses one question-conditioned scorer of about 1.9M parameters to drive two steps: a quarter-resolution glance that re-encodes only the 25% of cells relevant to the question at native resolution, then an evidence-tempered diversity rule that picks the final tokens. At 5% of the visual tokens on Qwen3.5-4B, it retains 91.6% of full-token performance across fourteen benchmarks, 17.3 points above the prior best LT-OPD, and reaches the first token 3.1 times sooner on 4K images.