Skip to main content
Search

# Channel-Adaptive Self-Supervised Learning

1 related articles

Subscribe to updates
  1. arXiv

    Encoding channels separately wins at scale: Meta FAIR's DINO-BoC beats joint channel encoding on microscopy and satellite imagery

    Scientific images differ in channel count and semantics, and joint channel encoding was long assumed necessary to learn cross-channel relations. Meta FAIR and collaborators compared strategies on an extended training set of about 7.75 million images and found that DINO-BoC, which encodes each channel independently and concatenates features at inference, outperforms the joint-encoding Channel-ViT on most microscopy and geospatial tasks and exceeds the supervised HyperNet baseline on CHAMMI's mean linear-probe out-of-distribution score. The finding covers in-domain, cross-dataset and unseen channel combinations, though protein-localization tasks still need a linear probe to catch up under nearest-neighbor evaluation.

You’re all caught up