JEPA4R reads single-depth-camera point clouds: imagined rollouts decode into 4D clouds within 1.1 cm over 200 steps
JEPA4R replaces the image input of a JEPA world model with colored point clouds from a single depth camera, predicts and plans in their latent space, and acts through a policy head on the frozen latents, a procedure the authors call 4D point planning. It leads pixel JEPA models on OGBench Cube-Single, Cube-Double, Cube-Triple and Scene, and ranks first on CortexBench's MetaWorld and Adroit Relocate at 98.4% and 88.0% success, above the runner-up R3M at 96.0% and 65.3%. A decoder attached to the frozen world model turns every imagined rollout into 4D point clouds, with mean point error within 1.1 cm over 200 environment steps.