A model can teach itself to reason without an answer key: Stone moves agreement to easier stepping stones, gaining 13.2 and 22.7 points without thinking mode
On-policy self-distillation lets a language model be its own teacher, but that teacher still reads a ground-truth solution. Stone instead has the model write easier related problems for the ones it is unsure about, keeps only those it solves consistently, and shows the teacher their worked solutions with final answers removed; the student sees only the original problem. Across five math benchmarks, Qwen3-4B and Qwen3-8B reach the highest averages in thinking mode and gain 13.2 and 22.7 points without thinking mode, 2.5 and 2.7 times the gains of OPSD with ground-truth solutions.