Distillation updates were going to style words: SD-OPD takes strength from the student's own shift and beats OPD by 7.76 to 10.37 points on six-task math average
On-policy distillation (OPD) uses the teacher–student log-probability difference as each token's update strength, but on math reasoning responses that difference at style-related positions averages 3.5 times its value at mathematical positions, so updates lean toward matching the teacher's expression. SD-OPD instead references the student's own pretrained base, sets update strength from the student–base log-probability change, keeps a coefficient only when its sign agrees with teacher feedback, and recomputes the student signal after each training round. Across 5 teacher–student configurations with Qwen3 students of 1.7B to 8B parameters, SD-OPD raises six-task mathematics average pass@1 (avg@16) over OPD by 7.76 to 10.37 percentage points.