Skip to main content
Search

# STAM-ASR

2 related articles

Subscribe to updates
  1. arXiv

    STAM-ASR extends a pretrained AudioLLM with speaker-temporal anchoring and memory, evaluated on AMI, ICSI, LibriCSS, and NOTSOFAR-1 for multi-speaker ASR

    The work proposes STAM-ASR, a lightweight framework that extends an already pretrained AudioLLM for multi-speaker ASR without relying on an external diarization system, learning speaker activity and speaker-aware representations directly from intermediate AudioLLM features to provide explicit who-and-when cues that modulate the semantic representation, while maintaining fixed-size speaker and conversational memories to carry complementary context across turns; it is evaluated on AMI, ICSI, LibriCSS, and NOTSOFAR-1 across close-talk, far-field, overlapping, and cross-domain conditions, with reported results showing that speaker-temporal conditioning and memory provide complementary benefits and that the gap between reference and predicted speaker activity identifies robust speaker tracking

  2. arXiv

    STAM-ASR extends a pretrained AudioLLM with speaker-temporal anchoring and memory for multi-speaker ASR, evaluated on AMI, ICSI, LibriCSS, and NOTSOFAR-1

    STAM-ASR is a lightweight framework that, without relying on an external diarization system and without explicit speech separation, learns speaker activity and speaker-aware representations directly from intermediate AudioLLM features to give explicit who-and-when cues that modulate the AudioLLM's semantic representation, and maintains fixed-size speaker and conversational memories to carry complementary context across turns; it is evaluated on AMI, ICSI, LibriCSS, and NOTSOFAR-1 across close-talk, far-field, overlapping, and cross-domain conditions, with reported results showing that speaker-temporal conditioning and memory provide complementary benefits while the gap between reference and predicted speaker activity identifies robust speaker tracking as a key remaining challenge.

You’re all caught up