Skip to main content
Search

Mohammad Mahdi Derakhshani

1 related articles

Subscribe to updates
  1. arXiv

    LiFT lets looped DiTs keep improving beyond training depth: L/2 and XL/2 beat larger dense DiTs with fewer parameters and less inference compute

    LiFT supervises each loop of a recurrent DiT toward a point on a straight path from the model's initial velocity estimate to the flow-matching target, so a trained checkpoint can run far more inference loops than its training depth; on class-conditional ImageNet, L/2 and XL/2 checkpoints that reallocate inference compute toward recurrence reach lower FID than larger dense DiTs with fewer parameters and less inference compute, while at B/2 the dense model remains stronger.

You’re all caught up