Pixel-space diffusion stops tiling every patch: HiT groups related features and hits 1.48 FID on ImageNet at 600 epochs
Pixel-space diffusion trains directly on pixels without a pretrained visual encoder, but has trailed two-stage latent models in quality and training efficiency. HiT progressively merges related patch features into group tokens inside the backbone, lets deeper Transformer blocks process the compact sequence, and uses soft weights to restore features to their original positions, with a compression budget controlling the average ratio across the batch. On ImageNet 256×256, HiT-XL/16 reaches 1.48 FID after 600 epochs, better than JiT-H/16's 1.86 at comparable parameter count, and matches JiT's quality with about 40% of its cumulative training FLOPs.