Skip to main content
Search

Milad Yazdani

1 related articles

Subscribe to updates
  1. arXiv

    RRT turns rubric verdicts into item-response quality rewards, beating GRPO by 1.7 points on Qwen3.5-4B while cutting roughly half the judge requests

    The work introduces Rubric Response Theory (RRT), which treats rubric criterion verdicts as item-response evidence about a shared latent quality, infers each rollout's quality as the GRPO reward via a two-parameter item response model, and uses a Response Parameter Network to predict criterion difficulty and discrimination from prompt and criterion text with online EM updates as the policy changes; with Qwen3.5-4B as the policy, RRT's macro criterion score across Medical, Science, Rubrics as Rewards Science, and RubricBench is 1.7 points above GRPO, gains 2.8 to 5.6 points on Hard and Very hard criteria in Medical and Science, and at half the criterion budget adaptive Fisher selection keeps the macro criterion score within 0.1 points of GRPO with full judging.

You’re all caught up