Skip to main content
Search

# E2S2H

1 related articles

Subscribe to updates
  1. arXiv

    Recorded with glasses alone, Ego2Sim2Humanoid turns human video into humanoid training trajectories

    Whole-body vision-language-action models for humanoids depend on teleoperated robot trajectories, each requiring a trained operator driving a physical robot in real time. Ego2Sim2Humanoid converts everyday human recordings from Project Aria Gen 2 glasses into training data with robot-view images and verified action labels, through agentic real-to-sim reconstruction, grasp and stance planning, and reinforcement-learning correction in physics simulation. Fine-tuned only on this converted data, with no real-robot demonstrations of the target tasks, GR00T N1.7 lifted a bottle in 9 of 20 autonomous trials and put on a hat in 5 of 20 on a Unitree G1.

You’re all caught up