Skip to main content
Search

Xinrui Zu

1 related articles

Subscribe to updates
  1. arXiv

    Robot multimodal alignment gains a structural check: UniOMA pulls vision, force and touch into one shared geometry

    Multimodal contrastive learning for robot perception usually pulls paired samples of the same instance together without constraining how samples relate to one another inside each modality, so embeddings can be statistically aligned yet geometrically inconsistent. UniOMA adds a Gromov–Wasserstein regularizer to InfoNCE-style contrastive losses, builds an intra-modal similarity kernel per modality, and learns a cross-modal GW barycenter as a structural consensus that each modality aligns to. Across five robotic benchmarks, adding the term improves regression, classification and cross-modal retrieval in most paired comparisons and raises rank correlation between embedding structure and an input-kernel reference.

You’re all caught up