May 12–18: 6 frontier papers out of 1,842 read.
Papers rated as moving the field
How we choose“We evaluate a range of frontier and open-weight models on SWE Atlas and find that GPT-5.4 and Opus 4.7 achieve the strongest overall performance, while even the best open-weight models score poorly.”
The authors, in the abstract
Benchmarking Coding Agents Beyond Issue Resolution
“Crucially, among successful retrievals, poisoned memories cause attacker-intended agentic actions in 60-89% of evaluations across models.”
“By replacing redundant exploration with directed optimization, Metis reduces token costs by an average of 8.2x and up to 11.4x.”
“We find that judgments across structured understanding and open-ended preference tasks share a sparse, generalized Latent Evaluator sub-graph in the mid-to-late multi-layer perceptrons (MLPs); zero-ablating it collapses judgment while preserving world knowledge in architecturally modular models.”
May 12–18: 72 cleared, 6 frontier
The week’s papers have not been sorted into fields yet.
Papers this week that name the model
Papers this week with an author at the lab
66 papers