VECTOR WIREAI INTELLIGENCE
⌘K
PKT
Refresh Models —Deals —Regulatory —Sources —

Questions this page answers

Which is better, Gemma 3 27B or Qwen2.5 VL 32B Instruct?
Across 12 shared benchmarks, Gemma 3 27B scores higher on 4 and Qwen2.5 VL 32B Instruct on 7, with 1 level. The widest gap is mathvision, where Gemma 3 27B scores 46 against 40.

Gemma 3 27B vs Qwen2.5 VL 32B Instruct

Across 12 shared benchmarks, Gemma 3 27B scores higher on 4 and Qwen2.5 VL 32B Instruct on 7, with 1 level. The widest gap is mathvision, where Gemma 3 27B scores 46 against 40.

GooglevsAlibaba12 shared benchmarks4–7 head-to-head
BenchmarkGemma 3 27BQwen2.5 VL 32B Instruct
arena_vision11651153
docvqa86.694.8
GPQA Diamond4646
humaneval87.891.5
MATH8982.2
mathvision4640
MathVista67.674.7
MBPP74.484
mmlu76.978.4
MMLU-Pro67.668.8
MMMU64.970
MMMU-Pro49.749.5

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.