Pathology images and multilayer molecular profiles share one embedding: Multi-Embed lets morphology and molecules retrieve each other
Multi-Embed places multilevel tissue morphology and multilayer molecular profiles in a single interpretable embedding space, so pathology images and molecular profiles can be inferred from and integrated with each other in both directions. Multimodal learning had left methodological challenges in cross-modality inference and integration, and the framework reports superior performance across benchmark tasks including morphology-molecule inference, fine-grained tissue architecture identification and spatiotemporal trajectory modeling. Evaluation covers paired pathology images and RNA-seq from 12 cancer types in TCGA and adds external validation on independent datasets such as CPTAC.