OncoVision's attention-driven multimodal training framework cut reading time by up to 61% and raised diagnostic confidence in a paired six-radiologist evaluation
OncoVision is a privileged-information training framework that uses mammography images and clinical features during training while performing inference from mammographic images alone; built on an attention-based encoder-decoder backbone, it jointly segments four regions of interest (masses, calcifications, axillary findings, and breast tissue) with accuracy exceeding the nnU-Net baseline and predicts ten structured clinical features including BI-RADS category; the authors developed two late-fusion strategies, Independent and Dependent, that integrate imaging, radiomic, and clinical information during training, with radiomic features extracted from predicted masks providing shape, intensity, and texture descriptors that complement the learned CNN representations; in a retrospective multi-re