Skip to main content
Search

# Ovis-Embedding

1 related articles

Subscribe to updates
  1. arXiv

    Ovis-Embedding puts text, image, video and audio into one retrieval space on a shared Qwen-Omni backbone, scoring 58.46 overall on MMEB-v3 at 3B scale

    The work reports the Ovis-Embedding family of universal omni-modal embedders: it uses a pretrained Qwen-Omni model as a shared backbone, removes the speech-generation pathway and takes the final-layer hidden state at the last non-padding token as the embedding, trains on an omni-modal corpus of roughly 50M query-target pairs with homogeneous-source sampling, focal loss and embedding distillation, and adds low-rank feature decomposition for elastic embedding dimensions, reporting leading results on MMEB-v3, MMEB-v2, MVEB, MAEB and RTEB.

You’re all caught up