Skip to main content
Search

# Hard Negative Mining

3 related articles

Subscribe to updates
  1. arXiv

    Omni-Embed-Mini binds speech, audio, image, video and visual documents into one cosine space via a frozen text backbone, holding text retrieval at 49.57 nDCG@10 with 0.9B parameters

    MBZUAI presents Omni-Embed-Mini, which recasts cross-modal alignment as self-distillation through a shared frozen backbone: each media sample is paired with a dense cascaded caption and the teacher target is simply that same frozen backbone's embedding of the caption, so only projectors and phased LoRA adapters are trained; the 0.9B variant maps text, speech, audio, images, video and visually-rich documents into one cosine space while keeping text weights bit-identical, scoring 49.57 nDCG@10 on MTEB-v2 BEIR-8, and the 2.3B variant edges ahead of the closed gemini-embedding-2 on the overall-modality average, 51.39 to 49.51.

  2. arXiv

    AutoDataBench scores Kimi-3 highest at 60.68 overall, yet the retrieval leader on in-distribution data ranks last out of distribution

    The work introduces AutoDataBench, a controlled testbed that isolates data intelligence under fixed training pipelines and resource budgets across tool-use data diagnosis and repair, retrieval data organization, and knowledge injection, evaluates seven frontier LLMs on iterative data decisions, finds that agent-curated data approaches expert references on tool use and retrieval while strong in-distribution scores do not guarantee out-of-distribution transfer, and shows that reusing optimization trajectories as mid-training data improves downstream coding performance.

  3. arXiv

    From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generation

    The work proposes a generation-oriented 3D-CLIP encoder trained with structured hard negatives constructed exclusively at the text level (Attribute-Aware Negatives, AAN, and Semantic-Aware Negatives, SAN) to strengthen contrastive learning under the small-batch constraints of volumetric encoders, and uses it to condition a fully end-to-end latent diffusion model operating directly in 3D latent space, achieving lower FID, higher pathology-classification AUC and precision, faster inference, and lower GPU memory than competing methods on CT-RATE across 18 pathological conditions.

You’re all caught up