Skip to main content
Search

# ATI-OPD

1 related articles

Subscribe to updates
  1. arXiv

    Long-sequence distillation stops handing the teacher the whole answer: ATI-OPD rewrites only the earliest divergent segment, and students' average accuracy on their own beats standard on-policy distillation

    On-policy distillation trains a student on its own responses using token-level teacher feedback, but as responses grow longer the student's prefix drifts from the teacher's own reasoning and later feedback weakens, bringing gradient spikes and extremely long responses. ATI-OPD has the teacher insert a short replacement at the earliest high-disagreement segment, hands generation back to the student, and excludes persistently divergent suffixes from the distillation loss. Across five mathematical reasoning benchmarks and two 1.5B teacher-student pairs, average student-only accuracy exceeds standard on-policy distillation.

You’re all caught up