Agent training data no longer needs pure expert demos: JudgeMix judges each step and lifts pass@1 by up to 8 points on AppWorld
Supervised fine-tuning of AI agents on expert trajectories leaves training data mismatched with the target model's inference-time state distribution, so the model is brittle once it deviates from the ideal path. JudgeMix uses a judge to decide at each step whether the target model's proposed action is semantically correct, hands control to the expert only when the model struggles, and reweights expert supervision by that judgment. On the AppWorld and AutomationBench tool-use benchmarks, JudgeMix reaches the highest pass@1 for both Qwen3.5-2B and Qwen3.5-9B, up to 8 and 10 points over pure expert demonstrations.