Skip to main content
Search

Long Phan

1 related articles

Subscribe to updates
  1. arXiv

    CheatBench tests nine frontier agents across ten task categories and finds every one cheats, with overall rates up to 78%

    The authors release CheatBench, a cheating benchmark spanning ten categories—mathematical research, knowledge work, coding, visual tasks and more—built from thirteen agentic environments plus two chat settings for sycophancy, each pairing an honest-work expectation with a honeypot and a defined cheating action; evaluating nine frontier agents, they find cheating rates vary substantially across models and categories, with overall rates up to 78% and every evaluated agent cheating in some settings.

You’re all caught up