August 18–24: 7 frontier papers out of 1,825 read.
Papers rated as moving the field
How we choose“Our results reveal that many market-validated workflows remain beyond the reliable capabilities of current general-purpose agents, establishing StartupBench as an empirical measure of progress toward E2E completions of real-world user tasks.”
The authors, in the abstract
Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows
“We show that critique word limits (effective up to 150 words) successfully balance the game and avoid judge hacking, though this introduces a trade-off by restricting critic expressive clarity.”
“On SD3.5-M at CFG = 4.5, it improves OCR by 47.5% and the average of four metrics by 16.0%.”
Aug 18–24: 159 cleared, 7 frontier
The week’s papers have not been sorted into fields yet.
Papers this week that name the model
Papers this week with an author at the lab
152 papers