Cross-model interpretability stops talking past itself: GB-SAE unifies ViT, SigLIP and DINOv2 concepts in one shared dictionary
Foundation models trained on similar data learn overlapping semantics, yet their representations are incompatible, and earlier methods only aligned each model's own concepts in a shared coordinate system while the concepts themselves stayed unshareable. GB-SAE casts cross-model interpretability as representation factorization, using a shared bottleneck encoder and a learnable gate to split latents into a shared dictionary and private dictionaries; on ImageNet-1K representations from ViT, SigLIP and DINOv2, the shared dictionary alone reaches a mean of 0.53/0.55 (projected/raw) and total reconstruction reaches 0.60/0.60, a 60% improvement over predicting the feature mean.