Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

AI Research Radar

Saturday, April 25: 1 frontier paper out of 135 read.

1 frontier21 cleared135 papers read

Frontier

Papers rated as moving the field

How we choose

HWE-Bench

“We evaluate seven LLMs with four agent frameworks and find that the best agent resolves 70.7% of tasks overall, with performance exceeding 90% on smaller cores but dropping below 65% on complex SoC-level projects.”

The authors, in the abstract

Benchmarking LLM Agents on Real-World Hardware Bug Repair Tasks

BenchmarkarXivPDF

This week in research

Apr 19–25: 21 cleared, 1 frontier

The week’s papers have not been sorted into fields yet.

Models under test

Papers this week that name the model

  1. Llama 3.1 8B Instruct1
  2. Gemini 3.1 Pro1
  3. Mistral Large1
  4. Mistral Large 31

Labs publishing

Papers this week with an author at the lab

  1. Alibaba1
  2. Google1
  3. IBM1
  4. Microsoft1

Also cleared

20 papers

All 20 papers