Skip to main content
Search

# Spatial Multimodal RoPE

1 related articles

Subscribe to updates
  1. arXiv

    Any Channel Count Into One Token Stream: SpheraAudio Beats Spatial-Omni-7B on Spatial Audio Benchmarks

    Large audio-language models usually collapse sound to mono to keep general audio understanding stable, leaving the inter-channel phase relations that encode direction and distance unused. SpheraAudio accepts mono, stereo, first-order and higher-order Ambisonics recordings, encodes multichannel complex spectra into spatial tokens, and interleaves them with audio tokens by time before the language model. At 4B parameters it leads on SpheraQA, SO-Bench and TWNM, reaching 60.18% overall on SpheraQA, 18.53 percentage points above Spatial-Omni-7B.

You’re all caught up