Skip to main content
Search

# Size-Matched Null Ablation

1 related articles

Subscribe to updates
  1. arXiv

    MambaVision block ablation mostly measures positional fragility: with size-matched nulls, per-block content effects fall to a fraction of a point

    In hybrid vision backbones such as MambaVision, which interleave Mamba state-space mixers with self-attention, removing one block and reading the accuracy drop has served as the measure of that block's contribution. Across all 50,000 ImageNet validation images, each ablation was paired with a size-matched null, the same perturbation with channels shuffled or signs flipped, and real and null damage were nearly indistinguishable in top-1 accuracy and true-class rank. The same test detects content effects in DeiT-Small and Swin-T, so single-block ablation in MambaVision mainly reflects how sensitive the residual stream is to where and how large a perturbation is, not what the block computes.

You’re all caught up