Skip to main content
Search

# Probabilistic safety judge

1 related articles

Subscribe to updates
  1. arXiv

    Keep Jev's probability as the safety reward, not a 0/1 verdict: with a helpfulness term, HarmBench attack success on Llama-3.1-8B falls from 0.287 to at most 0.033

    The harmful-probability output of the commercial safety judge Jev is used directly as a reinforcement-learning reward instead of being binarized, with a four-stage validation run before training, during training, and after each judge version change. On Llama-3.1-8B, the probability reward with a helpfulness term lowers HarmBench attack success from a 0.287 baseline to at most 0.033 at the final checkpoint; binarizing the same judge makes the share of confidently passed harm rise significantly in both seeds, meeting the escape criterion.

You’re all caught up