Ego2X turns first-person video into robot data by tracking object contacts, lifting X-VLA success from 40.5% zero-shot to 63.5% on paired scenes
Converting first-person video into executable robot data has relied mainly on transferring hand and arm motion and judging fidelity by visual appearance; but monocular hand estimates drift along the viewing ray while stable manipulation needs fine contact on the object surface, so fingers hover beside objects and grippers close on empty space. Ego2X instead works in the object frame, recording each contact by its surface anchor, relative force, grasp mode and interaction state, and carries that record through depth correction, inverse kinematics and video compositing. In RoboTwin 2.0, post-training X-VLA on verified Ego2X episodes alone, without simulator expert demonstrations, raises task success on paired scenes from 40.5% zero-shot to 63.5%.