Skip to main content
Search

# ReDiverse

1 related articles

Subscribe to updates
  1. arXiv

    Few-step diffusion students lose directions, not variance: ReDiverse restores diversity at one intermediate block

    Distilling a diffusion model into a four-step student makes different random seeds produce nearly identical images and videos for the same prompt. By comparing teacher and student activations block by block, ReDiverse finds that the student keeps its total activation variance but concentrates it into far fewer directions, at one intermediate block during the first denoising step. ReDiverse-FT then uses LoRA at that block to regress the student's first-step activations onto the teacher's, while ReDiverse-TF perturbs activations along teacher principal directions; across four teacher-student pairs on SDXL, SD3, Wan 2.1 and MiniMax-H3, both restore diversity while largely preserving generation quality.

You’re all caught up