Skip to main content
Search

# Reward gain imbalance

1 related articles

Subscribe to updates
  1. arXiv

    Equal rubric weights do not mean equal reward: DCC clips each criterion's score to a dual-center interval and lifts ranking accuracy

    Rubric-based reinforcement learning usually adds up per-criterion judge scores with equal weights, yet criteria differ in how far their scores separate satisfied from unsatisfied responses, so equal weights do not give equal contributions. The work formalizes this as reward gain imbalance and derives an exact split of the reward difference between two candidates into a base satisfaction signal, an imbalance term and a residual; the imbalance term can amplify or attenuate the base signal, and misrankings concentrate on pairs it attenuates. The proposed Dual-Center Clipping aggregation (DCC) estimates two centers from the current candidate group alone and bounds each criterion's contribution; it beats the compared methods on the Exact metric across two datasets and two judge models.

You’re all caught up