August 26 – September 1: 11 frontier papers out of 2,168 read.
Papers rated as moving the field
How we choose“Among open-weight models, Qwen3.8-Max-Preview leads with 416,252, 38% above GLM 5.2 (high), and achieves the strongest learning over the horizon, progressively bargaining down prices across repeated orders.”
The authors, in the abstract
Evaluating LLM Agents on Long-Horizon Autonomous Business Operation
“Though we establish that our construction provably evaluates Boolean expressions -- a universal symbolic computation -- of arbitrary length perfectly, in other experiments we also demonstrate that our transformer variant can learn and generalize perfectly (100% accuracy) on other common length generalization benchmarks, including modular arithmetic and ListOps.”
“Results show that appropriate harness design can meaningfully improve performance, particularly on demanding workflows, while the effectiveness of specific designs can vary across foundation models.”
“Agents cheat even under a second condition where they are prompted not to -the mean cheating rate remains above 50%.”
“EASEL-9B, trained on EASEL-Data, surpasses the base model by a relative 6.3%, ranking third among all evaluated models.”
“The single-layer graft recovers the capability in 28 of the 33 runs of the prompted, fine-tuned, and RL-trained locks, with a median held-out recovery of 96%.”
“Extensive evaluations show that A.X K2 performs competitively against strong open-weight baselines, matching or exceeding them on math and Korean-language benchmarks.”
“A broad "in any form" policy clause also closes it at the acting model (to 0%) but is brittle (dropping the catch-all reopens it to 48.8%).”
“Scores reached 87.6 and 94.9, but the highest Pass Rates were only 4% and 0%.”
“We show that this is a failure of composition rather than an implementation detail.”
Aug 26 – Sep 1: 203 cleared, 11 frontier
The week’s papers have not been sorted into fields yet.
192 papers