Radiology contrastive pretraining drops paired-identity targets: CorLIP lifts sentence-level AUC from 68.2 to 81.6 and keeps large batches trainable
Radiology image-text contrastive pretraining has inherited CLIP's paired-identity target, treating every other report in a batch as a negative, yet radiology reports share many of the same findings, so that target is systematically biased. CorLIP instead counts a text as positive whenever its clinical assertions agree with the image, changing only the target matrix and leaving architecture and optimizer untouched. On MIMIC-CXR, sentence-level CorLIP raises zero-shot 14-class mean AUC from 68.2 for vanilla CLIP to 81.6 and largely removes the post-peak decline; the same correction transfers to 3D CT.