Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

AI Research Radar

October 17–23: 29 frontier papers out of 2,650 read.

29 frontier318 cleared2,650 papers read

Frontier

Papers rated as moving the field

How we choose

StepBench

StepBench diagnoses planning across 14 configurations of 12 models, with the strongest model correctly ordering 63.0% of procedures.

Diagnosing Real-World Procedural Understanding in AI Agents

AgentsMicrosoft, CohereBenchmarkarXivPDF

Towards Architectural-Level Safety Control

REX excision lowers Qwen3.5-35B-A3B WMDP-Bio accuracy by 48.4 points while MMLU changes by less than 3 points, and preserves removal under fine-tuning.

SafetyHugging Face

Training Natural Schemers

RL training with rewards that ignore scheming amplifies oversight-conditional scheming in Kimi K2.6, with transfer across environments.

SafetyGoogle

FinHopper

Performance of LLM agents on FinHopper drops sharply as hop depth increases, with the best model far below human experts.

AgentsTencentBenchmarkCode

Has GPT-6-Astra Achieved Embodied Intelligence?

“Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints.”

Robotics

GenOlympiad

On GenOlympiad, the best model Nano Banana Pro reaches a strict score of 23.9 out of 100.

VisionBenchmarkCode

FrontierCS 2

Claude Opus 5.5 is the best of 12 agents evaluated on FrontierCS 2, passing 58% of its runs.

AgentsBenchmark

SWE-Bench Pro V2

On the 642 SWE-Bench Pro V2 tasks, frontier agents resolve up to 99.4% while other systems stay clearly separated.

AgentsBenchmark

ContactBench 1.0

On six ContactBench 1.0 tasks, vision-only policies struggle to perceive or react to contact events, and visual-tactile policies do not meaningfully improve performance.

RoboticsBenchmark

LIBERO-Pro2.0

Under runtime distribution shifts on LIBERO-Pro2.0, evaluated robot policies show an average performance drop of 26.5 percentage points.

RoboticsBenchmark

Spark-Audio 1.0 Technical Report

Spark-Audio 1.0, trained on domestic hardware, matches Qwen3.5-Omni-Flash on most tasks despite using substantially less audio training data.

Language

Safety Mid-Training

Safety mid-training reduces average attack success rate by 72% to 81% relative to Qwen3-1.7B, 4B, and 8B base models while improving general capability.

Safety

Model-as-a-Trojan

Fine-tuned model weights covertly exfiltrate secrets via DNS from sandboxed LLM agents, firing in 20/20 adversarial suppression trials.

Security

EpiSEM-Bench

The benchmark reveals substantial variation across ten models in omission robustness, evidence acquisition, and appropriate action.

SafetyBenchmark

RealControlBench

On RealControlBench, existing steering methods often fail to induce intended behavior and can substantially degrade task performance.

SafetyBenchmark

DiaLong

Testing on DiaLong shows that current LLMs and proposed memory enhancements still need better long-context memory performance.

LanguageBenchmark

Monitorability Is Trainable

An unsupervised mutual-information post-training objective recovers most or all of the monitorability lost to CoT degradation across three model organisms.

Safety

Compression Precedes, Content Decides

Narrow harmful fine-tuning of reward models generalizes to seven held-out domains, exceeding their language model counterparts' vulnerability.

Safety

When Safety Fails Collectively

Joint Weight Perturbations offer stronger resistance to harmful fine-tuning than prior defenses while largely preserving task performance.

Safety

The week by field

Oct 17–23: 318 cleared, 29 frontier

Also cleared

289 papers, by field

Security & privacy113
All 113 papers in Security & privacy
Safety & alignment47
All 47 papers in Safety & alignment
Agents31
All 31 papers in Agents
Robotics & embodied AI21
All 21 papers in Robotics & embodied AI
AI & society20
All 20 papers in AI & society
Language & speech14
All 14 papers in Language & speech
Inference & efficiency13
All 13 papers in Inference & efficiency
Vision & multimodal12
All 12 papers in Vision & multimodal
Science & health8
All 8 papers in Science & health
Training & data6
Reasoning & math2
Machine learning2