Which is better, o4-mini or Qwen3.5 2B?

o4-mini vs Qwen3.5 2B

20 SHARED BENCHMARKS

Across 20 shared benchmarks, o4-mini scores higher on 18 and Qwen3.5 2B on 2. The widest gap is Artificial Analysis Coding Index, where o4-mini scores 25.6 against 2.9.

OPENAIVSALIBABA20 SHARED18–2 HEAD-TO-HEAD

Benchmarko4-miniMARGINQwen3.5 2B

AA Agentic Index36.10.8

AA Intelligence266.9

AA-LCR6125.6

AA-Omniscience-35.7-60.2

AIME 202592.719

Artificial Analysis Coding Index25.62.9

critpt0.60

gdpval25.40

GPQA Diamond81.451.6

HLE16.55

IFBench68.741.3

MathVista84.348.7

mmlu_prox69.352.3

MMMU-Pro69.243

multichallenge44.933.7

OmniScience Accuracy24.88.1

OmniScience Non-Hallucination19.525.8

scicode46.57.2

Terminal-Bench Hard15.23.8

τ²-Bench Telecom (AA run)55.681.6

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.

Compare o4-mini withALL PAIRINGS →

OpenAIGPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.4 GPT-5.2 GPT-5

Across the fieldQwen3.6 27B Qwen3.7 Max Qwen3.8 Max Preview Qwen3.7 Plus Preview Claude Opus 4 Qwen3.5 4B Gemini 3.6 Flash Nemotron 3 Super 120B A12B

Compare Qwen3.5 2B withALL PAIRINGS →

AlibabaQwen3.5 35B A3B Qwen3 VL 4B (Reasoning)Qwen3.5 397B A17B Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus

Across the fieldClaude Sonnet 4.6 o1 Gemma 4 31B Kimi K2 Instruct Gemma 4 E2B GPT-4o mini Qwen3.6 35B A3B Gemini 3.5 Flash