VECTOR WIREAI INTELLIGENCE
⌘K
PKT
Refresh Models —Deals —Regulatory —Sources —

Questions this page answers

Which is better, Gemma 3 1B or Gemma 3 27B?
Across 11 shared benchmarks, Gemma 3 1B scores higher on 0 and Gemma 3 27B on 11. The widest gap is MMLU-Pro, where Gemma 3 27B scores 67.6 against 14.7.

Gemma 3 1B vs Gemma 3 27B

Across 11 shared benchmarks, Gemma 3 1B scores higher on 0 and Gemma 3 27B on 11. The widest gap is MMLU-Pro, where Gemma 3 27B scores 67.6 against 14.7.

GooglevsGoogle11 shared benchmarks0–11 head-to-head
BenchmarkGemma 3 1BGemma 3 27B
bbh39.187.6
BIG-Bench Extra Hard7.219.3
Global-MMLU-Lite34.275.1
GPQA Diamond19.246
GSM8K62.895.9
humaneval41.587.8
ifeval80.290.4
LiveCodeBench1.929.7
MBPP0.474.4
MMLU-Pro14.767.6
simpleqa2.210

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.