May 6–12: 4 frontier papers out of 1,642 read.
Papers rated as moving the field
How we choose“We evaluate a range of frontier and open-weight models on SWE Atlas and find that GPT-5.4 and Opus 4.7 achieve the strongest overall performance, while even the best open-weight models score poorly.”
The authors, in the abstract
Benchmarking Coding Agents Beyond Issue Resolution
“As an example, we investigate same-provider preference in final-round votes and find that models are 8.3 p.p. more likely to support a same-provider finalist than finalists from other providers.”
“We identify six exploit categories and find that 72% of reward hacking episodes include explicit chain-of-thought rationale, suggesting models often frame exploits as legitimate problem-solving.”
May 6–12: 75 cleared, 4 frontier
The week’s papers have not been sorted into fields yet.
Papers this week that name the model
Papers this week with an author at the lab
71 papers