Skip to main content
Search

# Pixel-Space Generative Models

1 related articles

Subscribe to updates
  1. arXiv

    Pixels alone can carry reasoning: models trained from scratch on raw pixels learn to work problems step by step like language models

    Existing image, video and unified multimodal generators almost never answer questions written in pixels on a canvas; they succeed only when a prompt rewriter or text module has already supplied the answer. To test whether pixels or training is at fault, researchers trained a family of purely pixel-space flow-matching generative models from scratch with no text pathway, from 7.6M to 458M parameters, taking and producing only pixels, reading questions, writing intermediate steps and answering on the canvas. These models show three hallmarks of large language models: per-step error falls with scale along a power law, frame-by-frame intermediate steps clearly beat single-frame answering, and reinforcement-learning post-training further strengthens reasoning.

You’re all caught up