VECTOR WIREAI INTELLIGENCE
⌘K
PKT
Refresh Models —Deals —Regulatory —Sources —

Questions this page answers

Which is better, Gemma 3 12B or Gemma 3 1B?
Across 11 shared benchmarks, Gemma 3 12B scores higher on 11 and Gemma 3 1B on 0. The widest gap is MMLU-Pro, where Gemma 3 12B scores 60.6 against 14.7.

Gemma 3 12B vs Gemma 3 1B

Across 11 shared benchmarks, Gemma 3 12B scores higher on 11 and Gemma 3 1B on 0. The widest gap is MMLU-Pro, where Gemma 3 12B scores 60.6 against 14.7.

GooglevsGoogle11 shared benchmarks11–0 head-to-head
BenchmarkGemma 3 12BGemma 3 1B
bbh85.739.1
BIG-Bench Extra Hard16.37.2
Global-MMLU-Lite69.534.2
GPQA Diamond40.919.2
GSM8K94.462.8
humaneval85.441.5
ifeval88.980.2
LiveCodeBench24.61.9
MBPP0.70.4
MMLU-Pro60.614.7
simpleqa6.32.2

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.