Skip to main content
Search

# Backward-Compatible Representation Learning

1 related articles

Subscribe to updates
  1. arXiv

    VIBRA upgrades a cross-modal retriever without re-encoding the gallery, winning all 50 settings at under 1 ms extra latency

    Upgrading the encoder of a cross-modal retrieval system normally means re-encoding billions of gallery vectors, costing hundreds of GPU hours. VIBRA pools the queries of the new, old and an auxiliary encoder into a consensus barycenter that serves as teacher, then trains the new encoder through a low-rank update to inherit that consensus, so deployment runs one encoder. Across five benchmarks and five upgrades among six CLIP, MetaCLIP and SigLIP2 backbones, it is the best compatible method in all 50 settings, improving Recall@1 by up to 5.6 points over the strongest baseline and up to 18.0 points over the old model, while adding less than 1 ms to the new encoder's latency.

You’re all caught up