Removing Sandbagging in LLMs by Training with Weak Supervision
“We find that training with weak supervision can reliably elicit sandbagging models when supervised fine-tuning (SFT) and reinforcement learning (RL) are combined: SFT on weak demonstrations breaks the sandbagging behavior, enabling RL to then fully elicit performance.”
The authors, in the abstract