Which is better, o4-mini or Qwen3.5 4B?

o4-mini vs Qwen3.5 4B

20 SHARED BENCHMARKS

Across 20 shared benchmarks, o4-mini scores higher on 14 and Qwen3.5 4B on 6. The widest gap is gdpval, where o4-mini scores 25.4 against 8.3. Qwen3.5 4B is the cheaper of the two on tracked API pricing ($0.03 against $1.10 per million input tokens).

OPENAIVSALIBABA20 SHARED14–6 HEAD-TO-HEAD

Benchmarko4-miniMARGINQwen3.5 4B

AA Agentic Index36.136.3

AA Intelligence2620

AA-LCR6163

AA-Omniscience-35.7-58.4

Artificial Analysis Coding Index25.622.6

critpt0.60

gdpval25.48.3

GPQA Diamond81.477.1

HLE16.59.9

IFBench68.759.2

MathVista84.363.6

mmlu_prox69.371.5

MMMU81.673.4

MMMU-Pro69.265.4

multichallenge44.949

OmniScience Accuracy24.815.1

OmniScience Non-Hallucination19.513.4

scicode46.518.3

Terminal-Bench Hard15.218.2

τ²-Bench Telecom (AA run)55.692.1

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing. Quoted rates are the price-setter row we currently track for each model — its direct or vendor-official listing where one exists (direct, direct), otherwise the lowest tracked offer.

Compare o4-mini withALL PAIRINGS →

OpenAIGPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.4 GPT-5.2 GPT-5

Across the fieldGemini 3.6 Flash Nemotron 3 Super 120B A12B Claude Opus 4.8 Gemini 3.1 Pro Claude Opus 4.6 Claude Sonnet 4.5 Claude 3.5 Sonnet Gemini 3 Pro

Compare Qwen3.5 4B withALL PAIRINGS →

AlibabaQwen3.5 35B A3B Qwen3 VL 4B (Reasoning)Qwen3.5 397B A17B Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus

Across the fieldClaude Sonnet 4.6 o1 Gemma 4 31B Kimi K2 Instruct Gemma 4 E2B GPT-4o mini Qwen3.6 35B A3B Gemini 3.5 Flash