Uncertainty-Aware Reward Discounting for Mitigating Reward Hacking
“We demonstrate statistical significance of these improvements and robustness under up to 30% supervisory noise, albeit with a trade-off in peak observed reward compared to unconstrained baselines.”
The authors, in the abstract