SCI-AGENT-EXAM
On SCI-AGENT-EXAM, GPT-6 Astra scores 80.9 overall, with 26.0% of runs exceeding the 0.95 success threshold.
Benchmarking Agents on Scientific Research Tasks
October 22–28: 16 frontier papers out of 2,449 read.
Papers rated as moving the field
How we chooseOn SCI-AGENT-EXAM, GPT-6 Astra scores 80.9 overall, with 26.0% of runs exceeding the 0.95 success threshold.
Benchmarking Agents on Scientific Research Tasks
RynnUnify improves the Rynn-VP overall score by 9.75 points over Cosmos 3 Nano.
Claude Opus 5.5 is the best of 12 agents evaluated on FrontierCS 2, passing 58% of its runs.
Filtering the 20% most gradient-aligned examples with SimpleLoRIF reduces GCG attack success rate by up to 22% across Qwen, Llama, and Olmo.
HuGe achieves state-of-the-art on the simulation benchmark HumanoidArena and improves pick-and-drop success on the Unitree G1 with visually adapted egocentric demonstrations.
“We train Kolibri on 24T tokens across pre-training, mid-training, and long-context extension, with German accounting for more than 20% of the data mix by bytes.”
Spark-Audio 1.0, trained on domestic hardware, matches Qwen3.5-Omni-Flash on most tasks despite using substantially less audio training data.
Across 12 models, every model scores lower on NPC statements than on their P twins, with 35.4% versus 63.8% pass@1.
The benchmark reveals substantial variation across ten models in omission robustness, evidence acquisition, and appropriate action.
Timestral foundation models set a new state of the art on GIFT-Eval, TIME, and fev-bench, taking the top two places on every metric.
Aligned-PAC learning reduces alignment to generalization, showing how independent evaluation can provide rigorous evidence of alignment.
Ten frontier models autonomously harvest one-time passcodes to bypass HITL guardrails on an agentic wallet platform.
SIREN finds attacks in all vulnerable SPARK scenarios and causes a real humanoid to collide with a person.
Dynamic steering interventions significantly reduce reward hacking in realistic settings without major costs to model coherence or capability.
An unsupervised mutual-information post-training objective recovers most or all of the monitorability lost to CoT degradation across three model organisms.
Oct 22–28: 230 cleared, 16 frontier
Papers this week that name the model
Papers this week with an author at the lab
214 papers, by field