Skip to main content
Search

# Hierarchical Pretraining

1 related articles

Subscribe to updates
  1. arXiv

    SignRAG combines hierarchical pretraining with retrieval-augmented reinforcement fine-tuning to make a gloss-free SLT model beat gloss-supervised methods on all CSL-Daily metrics

    SignRAG is a unified gloss-free sign language translation framework that first learns linguistically grounded sign representations via fine-grained sign-text alignment, then jointly pretrains the sign encoder with Qwen3-8B, adds a target-domain-only retrieval gallery for instance-specific translation cues, and applies RUG-RFT combining translation-quality and retrieval-utility rewards to suppress harmful reliance; it sets new state-of-the-art results on CSL-Daily, PHOENIX-2014T, How2Sign, and OpenASL, and is reported as the first gloss-free approach to surpass gloss-supervised methods across all reported metrics on CSL-Daily.

You’re all caught up