Skip to main content
Search

Liangjian Wen

1 related articles

Subscribe to updates
  1. arXiv

    InfMasking masks features before fusion so no single modality dominates, lifting the synergy task 5.6 points over CoMM

    Multimodal fusion often leans on a dominant modality or on shared information, leaving unused the synergy that exists only when modalities are observed together. InfMasking randomly masks feature tokens of each modality before fusion and requires the masked fused representation to stay consistent with an unmasked view or a class proxy, turning the expectation over infinitely many masks into variational bounds under a Gaussian model. On the controlled Trifeature benchmark it reaches 77.0% on the synergy task, 5.6 points above CoMM, and 90.6% on uniqueness.

You’re all caught up