Frozen encoders get elastic embeddings: HERL uses hyperbolic geometry to span 8 to 8192 dimensions in two GPU-hours on one card
HERL lets a pretrained encoder's embedding dimension be compressed or expanded after the fact without retraining the encoder. Matryoshka representation learning needed costly end-to-end retraining and no post hoc expansion, while lightweight adaptor routes handled only compression or a single reduced size. HERL maps encoder outputs into Lorentzian hyperbolic space with an MLP and trains under a contrastive loss there, holding downstream performance from 32 to 8192 dimensions on image and text tasks, with 8-to-8192-dimensional representations trained in about two hours on one GPU.