Skip to main content
Search

# Visual Position Re-Anchoring (VPR)

1 related articles

Subscribe to updates
  1. arXiv

    Images Stay in Context but Slip Out of Reach: VPR Shifts Only Cached Visual-Key Rotary Phases, Lifting 97 of 100 Model–Task Scores

    Keeping an image inside a multimodal model's context window does not mean its details stay usable: with 32K text tokens inserted between image and question, Qwen2.5-VL-7B's DocVQA score falls from 93.5 to 52.6 ANLS. Visual Position Re-Anchoring (VPR) shifts the rotary phases of cached visual keys toward a short-context reference before question processing, leaving visual values, text cache entries and causal masks untouched and adding no forward pass. Across ten checkpoints and ten benchmarks, static VPR improves 97 of 100 model–task scores; in the TextVQA length study, all six models remain below their short-context references at 32K, so recovery is incomplete.

You’re all caught up