Skip to main content
Search

# Weight Space Learning

2 related articles

Subscribe to updates
  1. arXiv

    No need to finish every run: SOTF forecasts the finish from checkpoints, cutting the retained-model gap on heterogeneous zoos from 0.0643 to 0.0017

    When training a population of candidate networks, mid-run accuracy rankings need not match final rankings, and learning curves can cross. SOTF training predicts each candidate's final or five-epoch-ahead accuracy from checkpoint weight statistics and SANE latent representations, then stops the lower-ranked runs early. On ResNet-18 and ViT zoos with wide performance spread, pruning by forecast final accuracy lowers the mean best-retained-model gap from 0.0643 to 0.0017 and raises oracle top-5 recall from 0.11 to 0.72; on CNN zoos, pruning by current accuracy already retains a near-optimal model.

  2. arXiv

    TensorMutation skips retraining each mutant: a graph neural network predicts weight changes of pre-training mutations

    Deep-learning mutation testing has traded cost against realism: pre-training mutants resemble real faults more closely, but each one requires retraining the model. TensorMutation represents a trained model as a neural graph and uses a mutation-conditioned graph neural network to predict parameter changes directly, generating executable mutants without retraining. On 12 real-fault subjects its median behavioral similarity exceeds that of the post-training tool DeepMutation++, a difference that stays significant after Holm correction; differences from the pre-training tool DeepCrime and from a norm-matched random control are not significant.

You’re all caught up