Brain-signal zero-shot image retrieval stops relying on the last layer: SIRAZ reaches 92.5% Top-1 within subjects on THINGS-EEG
SIRAZ rebuilds the visual side of neural decoding as multi-depth, biologically inspired representations before aligning them with brain signals. Earlier methods mostly used only the final layer of a pretrained vision encoder or a fixed aggregation, leaving neural representations unlike the brain's hierarchical visual processing. SIRAZ feeds images through a foveated stream and a multi-scale Difference-of-Gaussians stream, takes features from several intermediate layers through a gated residual adapter, encodes brain signals with a direction-aware multi-scale temporal attention encoder, and aligns the two with a bidirectional contrastive loss. On THINGS-EEG in the intra-subject setting it reaches 92.5% Top-1 and 99.27% Top-5; on THINGS-MEG intra-subject it reaches 50.25% and 75%.