Reward Hacking Benchmark
“We identify six exploit categories and find that 72% of reward hacking episodes include explicit chain-of-thought rationale, suggesting models often frame exploits as legitimate problem-solving.”
The authors, in the abstract
Measuring Exploits in LLM Agents with Tool Use