Medical retrieval's dense vectors split into readable features: sparse codes beat original embeddings on CURE, and explanations still predict activations across corpora
Medical retrieval systems usually compress queries and documents into dense vectors whose matches are hard to explain. This work trains sparse autoencoders on those dense embeddings with an InfoNCE contrastive loss that preserves query-document relevance, raising NDCG@10 above the original embeddings for all three embedders on CURE. Neuron interpretations built only from CURE texts still positively predict whether a neuron fires on five out-of-domain corpora, and concept-level interpretations outperform raw example snippets.