Skip to main content
Search

Xiaoyu Wu

1 related articles

Subscribe to updates
  1. arXiv

    Pixel-space diffusion stops tiling every patch: HiT groups related features and hits 1.48 FID on ImageNet at 600 epochs

    Pixel-space diffusion trains directly on pixels without a pretrained visual encoder, but has trailed two-stage latent models in quality and training efficiency. HiT progressively merges related patch features into group tokens inside the backbone, lets deeper Transformer blocks process the compact sequence, and uses soft weights to restore features to their original positions, with a compression budget controlling the average ratio across the batch. On ImageNet 256×256, HiT-XL/16 reaches 1.48 FID after 600 epochs, better than JiT-H/16's 1.86 at comparable parameter count, and matches JiT's quality with about 40% of its cumulative training FLOPs.

You’re all caught up