May 27 – June 2: 8 frontier papers out of 2,286 read.
Papers rated as moving the field
How we choose“Extensive evaluations of leading foundation models and commercial APIs reveal significant performance degradation in these challenging settings, exposing critical evaluation blind spots.”
The authors, in the abstract
A Real-World Multilingual Speech-to-Text Benchmark
“Our evaluation shows that coding agents with frontier models remain below 40% success on both evaluated engines.”
“Across three watermarking schemes and three open-source LLMs, the attack triggers 0/6 state-of-the-art content-side statistical detectors while inflating the watermark z-score up to 2.42x (system-level defenses such as entropy-source attestation remain orthogonal and complementary).”
“Experiments on seven strong open-source and closed-source LLMs show that state-of-the-art LLM agents remain vulnerable to Sleeper Attack, even when they achieve low attack success rates under a single-interaction baseline.”
“Experiments on multi-layer transformers confirm the theory and visualize how reasoning is progressively absorbed into deeper layers.”
“Our experiments demonstrate amplification across diverse biases: from keyword bias to propaganda (e.g., sexism), brand promotion, and instrumental goal-seeking.”
May 27 – Jun 2: 174 cleared, 8 frontier
The week’s papers have not been sorted into fields yet.
Papers this week that name the model
Papers this week with an author at the lab
166 papers