Skip to main content
Search

# Visual Residual Learning

1 related articles

Subscribe to updates
  1. arXiv

    Robot policies stop predicting the whole future frame: ResWAM learns only frame-to-frame residuals and reaches 81.1% on LIBERO-Plus

    World-action models usually have the policy predict complete future observations, but little changes within an action chunk: on LIBERO, current and future frame features share an average cosine similarity of 0.96, so the future loss is largely satisfied by copying static background. ResWAM instead supervises only the residual from the current frame to the future frame in a frozen DINOv3 feature space, and a 0.5B dual-branch DiT jointly denoises actions and residuals within 2.3B total parameters. Without robot pretraining it reaches 81.1% average success on LIBERO-Plus and 93.8% on RoboTwin 2.0, at 2.7–4.0 and 1.0–1.4 TFLOPs of training and inference compute.

You’re all caught up