Skip to main content
Search

Jingcheng Ni

1 related articles

Subscribe to updates
  1. arXiv

    Turn Before the Sound Ends: Streaming Human Reactions to Spatial Audio Cut First-Response Latency from 10.9 Seconds to About 193 Milliseconds

    Human reactions to spatial audio no longer wait for the whole clip. Earlier methods synthesized complete motion offline from fully observed acoustic and spatial input, so they could not react causally to an incoming stream. Sonic-AMG encodes acoustic content and body-relative source geometry as separate tokens, uses a causal transformer with a flow head to generate continuous motion latents block by block, and reconstructs motion segments with a causal decoder; it reaches state-of-the-art FID and R-precision on SAM and supports real-time online generation.

You’re all caught up