Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

AI Research Radar

October 15–21: 31 frontier papers out of 2,853 read.

31 frontier330 cleared2,853 papers read

Frontier

Papers rated as moving the field

How we choose

StepBench

StepBench diagnoses planning across 14 configurations of 12 models, with the strongest model correctly ordering 63.0% of procedures.

Diagnosing Real-World Procedural Understanding in AI Agents

AgentsMicrosoft, CohereBenchmarkarXivPDF

Towards Architectural-Level Safety Control

REX excision lowers Qwen3.5-35B-A3B WMDP-Bio accuracy by 48.4 points while MMLU changes by less than 3 points, and preserves removal under fine-tuning.

SafetyHugging Face

Training Natural Schemers

RL training with rewards that ignore scheming amplifies oversight-conditional scheming in Kimi K2.6, with transfer across environments.

SafetyGoogle

Multi-Reward Hacking

Trust-Anchored Gating achieves 0.581 pass@4 versus 0.220 for additive aggregation on Qwen3-4B with a brevity reward.

SafetyAmazon

FinHopper

Performance of LLM agents on FinHopper drops sharply as hop depth increases, with the best model far below human experts.

AgentsTencentBenchmarkCode

Has GPT-6-Astra Achieved Embodied Intelligence?

“Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints.”

Robotics

GenOlympiad

On GenOlympiad, the best model Nano Banana Pro reaches a strict score of 23.9 out of 100.

VisionBenchmarkCode

SWE-Bench Pro V2

On the 642 SWE-Bench Pro V2 tasks, frontier agents resolve up to 99.4% while other systems stay clearly separated.

AgentsBenchmark

ContactBench 1.0

On six ContactBench 1.0 tasks, vision-only policies struggle to perceive or react to contact events, and visual-tactile policies do not meaningfully improve performance.

RoboticsBenchmark

LIBERO-Pro2.0

Under runtime distribution shifts on LIBERO-Pro2.0, evaluated robot policies show an average performance drop of 26.5 percentage points.

RoboticsBenchmark

ChemArgus

“GPT-5.6-Sol scores 23.2% on unassisted whole-problem solving against 28.8% and 30.4% under the two sequential metrics, a gap measuring the integration burden.”

ReasoningBenchmark

REKI

The 2.4B REKI model sets a Pareto frontier between performance and size, outperformed only by models about twice its size.

RoboticsCode

Safety Mid-Training

Safety mid-training reduces average attack success rate by 72% to 81% relative to Qwen3-1.7B, 4B, and 8B base models while improving general capability.

Safety

Model-as-a-Trojan

Fine-tuned model weights covertly exfiltrate secrets via DNS from sandboxed LLM agents, firing in 20/20 adversarial suppression trials.

Security

DANGERLENS

“Experiments on three Qwen1.5 scales show that checkpoints with prior harmful exposure generally retain greater hazardous concept accessibility after the same safety alignment, with the strongest separation in intermediate and later layers.”

Safety

RealControlBench

On RealControlBench, existing steering methods often fail to induce intended behavior and can substantially degrade task performance.

SafetyBenchmark

DiaLong

Testing on DiaLong shows that current LLMs and proposed memory enhancements still need better long-context memory performance.

LanguageBenchmark

Compression Precedes, Content Decides

Narrow harmful fine-tuning of reward models generalizes to seven held-out domains, exceeding their language model counterparts' vulnerability.

Safety

When Safety Fails Collectively

Joint Weight Perturbations offer stronger resistance to harmful fine-tuning than prior defenses while largely preserving task performance.

Safety

LLM-jp-4 Technical Report

“Evaluation results demonstrate substantial improvements over previous LLM-jp models and competitive performance against open-weight models of similar scale.”

Training

The week by field

Oct 15–21: 330 cleared, 31 frontier

Also cleared

299 papers, by field

Security & privacy120
All 120 papers in Security & privacy
Safety & alignment44
All 44 papers in Safety & alignment
Agents34
All 34 papers in Agents
Robotics & embodied AI25
All 25 papers in Robotics & embodied AI
Inference & efficiency16
All 16 papers in Inference & efficiency
AI & society16
All 16 papers in AI & society
Vision & multimodal14
All 14 papers in Vision & multimodal
Language & speech10
All 10 papers in Language & speech
Training & data10
All 10 papers in Training & data
Science & health5
Machine learning4
Reasoning & math1