Skip to main content
Search

Jinchi Zhu

1 related articles

Subscribe to updates
  1. arXiv

    Cross-model interpretability stops talking past itself: GB-SAE unifies ViT, SigLIP and DINOv2 concepts in one shared dictionary

    Foundation models trained on similar data learn overlapping semantics, yet their representations are incompatible, and earlier methods only aligned each model's own concepts in a shared coordinate system while the concepts themselves stayed unshareable. GB-SAE casts cross-model interpretability as representation factorization, using a shared bottleneck encoder and a learnable gate to split latents into a shared dictionary and private dictionaries; on ImageNet-1K representations from ViT, SigLIP and DINOv2, the shared dictionary alone reaches a mean R2R^2 of 0.53/0.55 (projected/raw) and total reconstruction reaches 0.60/0.60, a 60% improvement over predicting the feature mean.

You’re all caught up