Skip to main content
Search

Ao Yu

1 related articles

Subscribe to updates
  1. arXiv

    DuoOPD Rewrites Distillation Feedback from Joint Teacher-Student Outcomes, Lifting Macro Accuracy by 2.58 Points on Qwen3 and 5.98 on Llama over OPD

    The work introduces DuoOPD, a multi-task on-policy distillation method in which the student's verified outcome sets the direction of feedback and the joint teacher-student outcome decides how the teacher supports it—when only the teacher succeeds its verified answer becomes context for scoring the student's failed response, and when only the student succeeds a weight shared within the task reinforces the whole response, with one rule covering all four outcome combinations and no task-specific settings; across Qwen3 and Llama, DuoOPD outperforms all five baselines in mean macro accuracy, improving over OPD by 2.58 and 5.98 percentage points, and it also leads on two further task mixtures spanning scientific calculation, instruction following, and code generation.

You’re all caught up