Skip to main content
Search

# Active VLM-TTA

1 related articles

Subscribe to updates
  1. arXiv

    Frozen vision-language models can spend a labeling budget too: ACTOR stores delayed labels as retrieval memory and gains 2.5 points across 15 datasets

    Test-time adaptation for vision-language models usually relies entirely on pseudo-labels or entropy the model produces itself, which can reinforce its own errors on hard shifted samples. ACTOR treats a small amount of deployment-time human labeling as delayed evidence: it predicts first, stores returned labels in memory, and corrects later samples only when the two nearest labeled neighbors agree and are close enough, leaving model parameters frozen. Across 15 datasets it averages 2.50 and 2.45 percentage points above online prompt tuning given the same labels, with under 1 ms of extra inference per sample.

You’re all caught up