Skip to main content
Search

# Visual Tokenizer

3 related articles

Subscribe to updates
  1. arXiv

    Discrete codes can carry vision too: dNaViT uses one codebook for understanding, reconstruction and generation

    dNaViT encodes images into discrete codes of the same kind language models predict, and one shared vocabulary serves visual understanding, image reconstruction, generation and editing. It builds on a frozen pretrained vision encoder, adds reconstruction-relevant detail through residual modulation, and uses grouped product quantization to widen discrete capacity without lengthening the spatial sequence. On ImageNet-1K, the 64-group dNaViT-G64 reaches 32.90 dB PSNR and 0.91 SSIM at 1024 spatial positions, and dNaViT-8B paired with Qwen3-8B scores 885 on OCRBench.

  2. arXiv

    Image generation splits in two: learn semantics, then render, and a 3B model reaches GenEval 0.86 in 6,600 H100 hours

    Visual generation is split into two stages: autoregressive pretraining acquires visual knowledge, and diffusion post-training renders it into pixels. In controlled comparisons at roughly 400M parameters, the autoregressive-then-diffusion route reached 65.5 on GenEval, above 61.2 for pixel diffusion trained from scratch, and a semantic tokenizer needed neither an image decoder nor a reconstruction loss to support rendering. Allocating compute by fitted scaling laws, a roughly 3B-parameter text-to-image model trained in about 6,600 H100 GPU-hours scored 0.86 on GenEval and 87.78 on DPG-Bench.

  3. arXiv

    DC-SAE splits image tokenization into semantic and pixel branches, hitting 32x compression with 3.37 gFID and 29.79 PSNR on ImageNet and a 4.41x speedup over DC-AE

    Peking University and Singapore University of Technology and Design propose DC-SAE, a decoupled compact semantic autoencoder that pairs a frozen semantic encoder for a generation-friendly compact latent with a trainable pixel encoder for low-level detail, achieving 29.79 PSNR and 3.37 gFID on ImageNet at 32x spatial compression, improving over DC-AE by 13.5% in PSNR and 54.9% in gFID with a 4.41x speedup, while a B-parameter DiT reaches 0.84 on GenEval and 86.007 on DPG-Bench.

You’re all caught up