Skip to main content
Search

# Few-Shot Adaptation

2 related articles

Subscribe to updates
  1. arXiv

    PhaseCLIP brings the phase spectrum into frequency-domain adaptation of a frozen CLIP: 84.28% mean accuracy across five remote-sensing benchmarks and 4.36 points on the hardest one

    PhaseCLIP extends frequency-domain adaptation of a frozen CLIP visual encoder from the amplitude spectrum to the phase spectrum, and lets one set of module weights learn phase first and refine with amplitude, so no parameters are added. Under a matched protocol on EuroSAT, PatternNet, UC Merced, RSSCN7 and LSRS, with 1 to 32 shots and eight baselines, it reaches 84.28% mean accuracy, 1.93 points above the amplitude-only FreqDIMFT and 4.36 points above it on the 113-class LSRS.

  2. arXiv

    Few-shot CLIP tuning stops trusting gradient size: sign-only updates with a refreshed support reach 72.7% on ViT-B/16 at one shot

    In few-shot CLIP adaptation, support-set gradient magnitudes are badly miscalibrated, yet the signs of a small top-magnitude subset still point toward descent. SignSparseSGD and DynSignSparseSGD therefore use gradient magnitude only to choose where to update and fixed-magnitude signs to decide how, keeping no first- or second-moment state. Across 11 datasets, three CLIP backbones and five shot levels, the dynamic variant has the highest mean accuracy in all 15 backbone–shot settings, reaching 72.7% on ViT-B/16 at one shot, 1.3 points above SO.

You’re all caught up