Which is better, Gemini 1.5 Pro or Qwen3.5 4B?

Gemini 1.5 Pro vs Qwen3.5 4B

12 SHARED BENCHMARKS

Across 12 shared benchmarks, Gemini 1.5 Pro scores higher on 4 and Qwen3.5 4B on 8. The widest gap is HLE, where Qwen3.5 4B scores 9.9 against 4.9.

GOOGLEVSALIBABA12 SHARED4–8 HEAD-TO-HEAD

BenchmarkGemini 1.5 ProMARGINQwen3.5 4B

AA Intelligence1020

Artificial Analysis Coding Index23.622.6

GPQA Diamond59.177.1

HLE4.99.9

ifeval89.489.8

MathVista70.663.6

MMLU-Pro75.879.1

MMMU68.473.4

MMMU (val) (Pass@1)54.150.3

MMMU-Pro5565.4

OCRBench8086.9

scicode29.518.3

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.

Compare Gemini 1.5 Pro withALL PAIRINGS →

GoogleGemini 3.1 Pro Gemini 3 Pro Gemma 4 26B A4B Gemini 2.5 Pro Gemma 4 31B Gemma 4 E2B

Across the fieldGemini 3.6 Flash Nemotron 3 Super 120B A12B GPT-5.5 Claude Opus 4.8 GPT-4o GPT-5.6 Sol GPT-5.4 GPT-5.2

Compare Qwen3.5 4B withALL PAIRINGS →

AlibabaQwen3.5 35B A3B Qwen3 VL 4B (Reasoning)Qwen3.5 397B A17B Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus

Across the fieldClaude Sonnet 4 Claude Sonnet 5 Muse Spark 1.1 GLM-5.1 GLM-5.2 o4-mini Claude Sonnet 4.6 o1