VECTOR WIREAI INTELLIGENCE
PKT
Refresh Models Deals Regulatory Sources

Questions this page answers

Which is better, Gemma 3 1B or Gemma 3 4B?
Across 11 shared benchmarks, Gemma 3 1B scores higher on 0 and Gemma 3 4B on 11. The widest gap is LiveCodeBench, where Gemma 3 4B scores 12.6 against 1.9.

Gemma 3 1B vs Gemma 3 4B

Across 11 shared benchmarks, Gemma 3 1B scores higher on 0 and Gemma 3 4B on 11. The widest gap is LiveCodeBench, where Gemma 3 4B scores 12.6 against 1.9.

GooglevsGoogle11 shared benchmarks011 head-to-head
BenchmarkGemma 3 1BGemma 3 4B
bbh39.172.2
BIG-Bench Extra Hard7.211
Global-MMLU-Lite34.254.5
GPQA Diamond19.230.8
GSM8K62.889.9
humaneval41.571.3
ifeval80.290.2
LiveCodeBench1.912.6
MBPP0.40.6
MMLU-Pro14.743.6
simpleqa2.24

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.