Skip to main content
Search

# Hand Pose Estimation

1 related articles

Subscribe to updates
  1. arXiv

    WinDEX turns in-the-wild egocentric stereo video into metric hand trajectories, with offline reconstruction at 43.61 FPS

    WinDEX converts hands recorded by a head-worn fisheye stereo camera in everyday scenes into metric, gravity-aligned hand motion in a world frame for robot teleoperation and reinforcement learning. Such data previously required optical motion capture, multi-camera rigs or gloves, or came from monocular video without absolute scale. The system generates annotations through geometric-temporal optimization, trains the end-to-end fisheye-native WinDEX-Net, and distills offline WinDEX-Window and causal streaming WinDEX-Stream; on held-out data, offline reconstruction reaches 14.5 pixels reprojection error and, with visual-inertial odometry, 37.29 mm world-frame joint error.

You’re all caught up