Skip to main content
Search

# Matryoshka representation learning

2 related articles

Subscribe to updates
  1. Cohere Labs

    Cohere launches Embed 5 with Pro at 85.8 average on ViDoRe V3 and Fast at 2.4x throughput sharing one embedding space

    Cohere released the Embed 5 family of embedding models in two tiers, Pro and Fast, which share a single embedding space and support 128K context, text/image/fused inputs, 100+ languages, and Matryoshka outputs from 2048 down to 256 dimensions; Pro averages 85.8 on ViDoRe V3 (an 8.8 gain over Embed 4), scores 80.1 on FinanceBench and 84.8 across the parsed-document suite, while Fast averages 84.5 on ViDoRe V3 with about 2.4x the document throughput of Pro, priced at $0.12 and $0.08 per million tokens respectively.

  2. arXiv

    Ovis-Embedding puts text, image, video and audio into one retrieval space on a shared Qwen-Omni backbone, scoring 58.46 overall on MMEB-v3 at 3B scale

    The work reports the Ovis-Embedding family of universal omni-modal embedders: it uses a pretrained Qwen-Omni model as a shared backbone, removes the speech-generation pathway and takes the final-layer hidden state at the last non-padding token as the embedding, trains on an omni-modal corpus of roughly 50M query-target pairs with homogeneous-source sampling, focal loss and embedding distillation, and adds low-rank feature decomposition for elastic embedding dimensions, reporting leading results on MMEB-v3, MMEB-v2, MVEB, MAEB and RTEB.

You’re all caught up