Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

AI Research Radar

October 16–22: 29 frontier papers out of 2,777 read.

29 frontier318 cleared2,777 papers read

Frontier

Papers rated as moving the field

How we choose

StepBench

StepBench diagnoses planning across 14 configurations of 12 models, with the strongest model correctly ordering 63.0% of procedures.

Diagnosing Real-World Procedural Understanding in AI Agents

AgentsMicrosoft, CohereBenchmarkarXivPDF

Towards Architectural-Level Safety Control

REX excision lowers Qwen3.5-35B-A3B WMDP-Bio accuracy by 48.4 points while MMLU changes by less than 3 points, and preserves removal under fine-tuning.

SafetyHugging Face

Training Natural Schemers

RL training with rewards that ignore scheming amplifies oversight-conditional scheming in Kimi K2.6, with transfer across environments.

SafetyGoogle

Multi-Reward Hacking

Trust-Anchored Gating achieves 0.581 pass@4 versus 0.220 for additive aggregation on Qwen3-4B with a brevity reward.

SafetyAmazon

FinHopper

Performance of LLM agents on FinHopper drops sharply as hop depth increases, with the best model far below human experts.

AgentsTencentBenchmarkCode

Has GPT-6-Astra Achieved Embodied Intelligence?

“Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints.”

Robotics

GenOlympiad

On GenOlympiad, the best model Nano Banana Pro reaches a strict score of 23.9 out of 100.

VisionBenchmarkCode

FrontierCS 2

Claude Opus 5.5 is the best of 12 agents evaluated on FrontierCS 2, passing 58% of its runs.

AgentsBenchmark

SWE-Bench Pro V2

On the 642 SWE-Bench Pro V2 tasks, frontier agents resolve up to 99.4% while other systems stay clearly separated.

AgentsBenchmark

ContactBench 1.0

On six ContactBench 1.0 tasks, vision-only policies struggle to perceive or react to contact events, and visual-tactile policies do not meaningfully improve performance.

RoboticsBenchmark

LIBERO-Pro2.0

Under runtime distribution shifts on LIBERO-Pro2.0, evaluated robot policies show an average performance drop of 26.5 percentage points.

RoboticsBenchmark

REKI

The 2.4B REKI model sets a Pareto frontier between performance and size, outperformed only by models about twice its size.

RoboticsCode

Safety Mid-Training

Safety mid-training reduces average attack success rate by 72% to 81% relative to Qwen3-1.7B, 4B, and 8B base models while improving general capability.

Safety

Model-as-a-Trojan

Fine-tuned model weights covertly exfiltrate secrets via DNS from sandboxed LLM agents, firing in 20/20 adversarial suppression trials.

Security

RealControlBench

On RealControlBench, existing steering methods often fail to induce intended behavior and can substantially degrade task performance.

SafetyBenchmark

DiaLong

Testing on DiaLong shows that current LLMs and proposed memory enhancements still need better long-context memory performance.

LanguageBenchmark

Monitorability Is Trainable

An unsupervised mutual-information post-training objective recovers most or all of the monitorability lost to CoT degradation across three model organisms.

Safety

Compression Precedes, Content Decides

Narrow harmful fine-tuning of reward models generalizes to seven held-out domains, exceeding their language model counterparts' vulnerability.

Safety

When Safety Fails Collectively

Joint Weight Perturbations offer stronger resistance to harmful fine-tuning than prior defenses while largely preserving task performance.

Safety

The week by field

Oct 16–22: 318 cleared, 29 frontier

Also cleared

289 papers, by field

Security & privacy113
All 113 papers in Security & privacy
Safety & alignment46
All 46 papers in Safety & alignment
Agents33
All 33 papers in Agents
Robotics & embodied AI22
All 22 papers in Robotics & embodied AI
Inference & efficiency16
All 16 papers in Inference & efficiency
AI & society16
All 16 papers in AI & society
Vision & multimodal13
All 13 papers in Vision & multimodal
Language & speech11
All 11 papers in Language & speech
Training & data8
All 8 papers in Training & data
Science & health7
All 7 papers in Science & health
Reasoning & math2
Machine learning2