Skip to main content
Search

# Self-Supervised Learning

31 related articles

Subscribe to updates
  1. bioRxiv

    Bloom learns brain-cell representations from 300,000 cells, spanning RNA and chromatin accessibility at 91%–94% subclass accuracy

    The Allen Institute for Brain Science and AWS have released Bloom, a single-cell multimodal model that encodes gene expression and chromatin accessibility into one shared cell representation while training on roughly 100-fold fewer cells than comparable pretrained models. On adult mouse whole-brain data, linear classifiers on Bloom embeddings reach 91% cross-validated adjusted balanced accuracy for 315 subclasses (multiome), 94% for 310 subclasses (scRNA-seq) and 94% for 297 subclasses (snRNA-seq), although the model saw only mouse multiome data.

  2. arXiv

    CARMEN packs ten cardiorespiratory waveforms into one encoder, beating task-specific models on most of 19 tasks with frozen weights

    A team at Seoul National University Hospital released CARMEN, a single encoder pretrained without labels on ten cardiorespiratory waveforms totaling about 2.27 million modality-hours, which accepts any combination of co-recorded signals and inputs from 10 s to 5 min. With the encoder frozen and only a linear layer trained, it was significantly better than end-to-end supervised models on 12 of the 15 tasks that had supervised comparators, and better than three pretrained foundation models on 14 to 17 of 19 tasks, with none exceeding it.

  3. arXiv

    AudioSphere learns spatial audio from multichannel self-supervision: a frozen backbone localizes real-world sound events for the first time

    AudioSphere extends self-supervised audio pretraining from single-channel to multichannel: it takes four-channel Ambisonics recordings and trains a masked autoencoder to reconstruct both spectrograms and intensity vectors, so a frozen backbone with a shallow probe performs sound event detection and localization in real scenes. Prior single-channel models were blind to spatial structure, while spatial models relied on clip-level supervision. It reaches an aggregate HEAR score of 83.2 and also supports frame-level localization.

  4. arXiv

    Raw radar spectra skip the point-cloud step: L-SPMAE pretraining lets a generic detector beat radar-specific detectors on K-Radar

    Radar 3D perception has long compressed raw spectra into sparse point clouds or compact Doppler statistics before supervised training. L-SPMAE instead uses masked self-supervision: whatever remains reconstructable under localized corruption counts as signal, and spectral leakage supplies that corruption, so pretraining runs directly on unreduced radar spectra. On K-Radar, L-SPMAE with the RAD representation reaches 55.9/50.1 mAP after fine-tuning, above the best point-cloud self-supervised baseline in the table at 50.8/45.0.

  5. arXiv

    Marine seismic multiple suppression moves to a self-supervised network: no smoothness constraint, better weak-signal and waveform preservation

    In marine seismic exploration, SRME (surface-related multiple elimination) predicts multiples and then subtracts them from the recorded data with a matching filter; the classical route uses either a fixed-length stationary filter or a non-stationary regression with a local smoothness constraint, which limits it where signal energy changes rapidly. PDL replaces that matching filter with a self-supervised neural network trained under the adaptive matching filtering equation, cutting the seismic profile into many patches so training yields a globally optimal non-stationary match. On synthetic data and the Viking Graben field dataset, PDL leaves fewer multiple residuals than the classical non-stationary least-squares matching filter and better preserves weak primaries and waveform continuity.

  6. arXiv

    Surgical vision encoders stop starting from natural images: InnerLogic-Surg leads all 20 surgical tasks with a frozen backbone

    Surgical image analysis has long relied on encoders pretrained on natural images or on specialist models trained from scratch on comparatively small annotated datasets. InnerLogic-Surg starts from DINOv3 and applies continual self-supervised pretraining to millions of frames drawn from 11,965 public surgical videos, about 2,900 hours across more than fifteen procedure types, yielding an encoder family of 21M to 300M parameters. Under a frozen-backbone protocol with only a linear readout trained, the family achieves the best linear-probe performance on all 20 tasks spanning workflow, instrument and anatomy recognition, segmentation, detection and monocular depth, with ViT-L leading on 18 axes and ViT-B best on GraSP step recognition and monocular depth.

  7. bioRxiv

    Flowing cells get organelle-level eyes: three structured-light frames plus self-supervised reconstruction reach about 118 nm at up to roughly 720 cells per second

    Super-resolution imaging flow cytometry (SR-IFC) brings structured-illumination microscopy into a continuous microfluidic stream: each cell yields only three phase-shifted frames, physical modulation sharpens the flow axis, and a network trained solely on the imaged sample's own data infers the missing transverse detail. On 100 nm fluorescent beads, SR-IFC reached about 118 nm along the flow axis and 110 nm across it, versus 222 to 227 nm for wide-field imaging of the same beads; with a 2048 × 320 pixel readout, the theoretical throughput ceiling is about 720 cells per second.

  8. arXiv

    Learn a function representation once, then freeze it: Daedalus beats GAOT on 23 of 28 PDE tasks and trains 2.1 times faster on average

    Daedalus separates function-representation learning from operator learning: a functional autoencoder is pre-trained only on analytic functions synthesized on the fly, with no solver and no labels, and the latent space it induces is frozen and reused across tasks. On 28 benchmark problems spanning fluid dynamics, solid mechanics, acoustics, and the Helmholtz and Poisson equations, operators on the frozen representation have lower relative error than the end-to-end framework GAOT on 23 of them and train 2.1 times faster per problem on average; that comparison excludes the one-time backbone pre-training.

  9. Nature Methods

    Cell morphology profiling drops segmentation: self-supervised models retrieve about a third more mechanism classes than CellProfiler across labs

    Cell morphology profiling has relied on cell segmentation and handcrafted features, which are annotation-hungry and hard to reuse across laboratories. Researchers pretrained four self-supervised models on 119,876 unannotated compounds and about 1.77 million JUMP–CP images, then froze the weights and extracted image embeddings directly. On 2,464 EU-OPENSCREEN Bioactives compounds, DINO and DINOv2 beat CellProfiler by 31–37% in site-averaged mean average precision for mechanism-of-action retrieval and consistently surpassed masked-based models.

  10. arXiv

    No label required: six routine core-logging measurements already carry the geologist's lithology name, and a thousand-fold label weight only drops reconstruction from 0.999 to 0.836

    Marine drill cores no longer need a geologist's rock name as a training target. The usual practice treats shipboard lithology as the ground truth a model should reproduce, yet the six measurements logged on every core (bulk density, magnetic susceptibility, natural gamma radiation and three reflectance channels) are the properties geologists read when they assign that name. A masked variational autoencoder trained on 236,963 observations from 296 boreholes in the LILY database, without labels, separates lithologies as well as a semi-supervised variant (adjusted Rand index 0.237 against 0.247), and raising the label weight a thousand-fold only drops reconstruction from 0.999 to 0.836 while classification barely moves.