Skip to main content
Search

# Counterfactual Supervised Fine-tuning

1 related articles

Subscribe to updates
  1. arXiv

    SUSTech and CityU propose Box2-Bench: frontier models use good workflows but lose up to 43.3 points under bad ones

    The authors introduce Box2-Bench, which holds the model and task fixed while varying workflow availability and reliability across five matched conditions (none, good, bad, partial, mixed), finding that frontier models such as Gemini 3.7 Flash, DeepSeek V4 Flash, and GLM 5.2 benefit from good workflows in 8 of 12 model-task pairs but are hurt by bad workflows in all 12 (drops of 3.3 to 43.3 points), and that mixed workflows underperform their matched partial workflows in 10 of 12 pairs; training two open-weight models on bad workflows only, counterfactual SFT cuts the bad-workflow penalty from 20.0 to 6.7 points on AIME and from 9.8 to 0.6 points on WebShop while weakening use of held-out good workflows, and outcome-based RL restores AIME utilization from -3.3 to +6.

You’re all caught up