Gemma 3 12B
Gemma 3 12B is behind the leaders in multimodal tasks. Too few results yet to rate reasoning, coding, agentic tasks, safety, long context, math, multilingual tasks, instruction following, or factuality.
Capability profile
Bars show the model's median result as a share of the leading model's, per capability. Select a row to see its results.
Too few results yet to rate Reasoning, Coding, Agentic, Safety, Long Context, Math, Multilingual, Instruction Following or Factuality.
Price
$0.05input$0.15outputper million tokens
From deepinfra · 2 providers tracked · All prices
Evidence
75results on68benchmarks
- 6 independently verified
- 19 aggregator
- 18 vendor-reported
- 32 cross-referenced
From 9 sources · latest Oct 7, 2026 · How verification works
API features
Tool callingStructured outputs
As listed by OpenRouter
Research
18 papers reference Gemma 3 12BGemma 3 12B benchmark results
75 results on 68 benchmarks, grouped by capability. Each bar is the result as a share of the capability leader's; every result links to its source.
51.4% behind the leader3 of 6 ranked benchmarks measured
0 of 6 ranked benchmarks measured
- 0.00Oct 7, 2026
- GPQA Diamond34.95Oct 7, 2026gpqa
- Humanity's Last Exam4.21Oct 7, 2026aa_hle
Show 1 more reasoning resultHide 1 reasoning result
- GPQA Diamond40.90Oct 6, 2026GPQA
0 of 10 ranked benchmarks measured
- SciCode16.44Oct 7, 2026aa_scicode
- Terminal-Bench 2.10.00Oct 7, 2026terminalbenchV21
- Terminal-Bench Hard0.76Oct 7, 2026aa_terminalbench_hard
0 of 7 ranked benchmarks measured
- 0.00Oct 7, 2026
- Terminal-Bench 4.00.00Oct 7, 2026
- τ-Bench V3 · Banking0.82Oct 7, 2026tauBanking
0 of 3 ranked benchmarks measured
- 8.33Oct 7, 2026
0 of 3 ranked benchmarks measured
- IFBench36.73Oct 7, 2026aa_ifbench
0 of 4 ranked benchmarks measured
- 4.40May 2, 2026
- AA-Omniscience · Accuracy10.30Oct 7, 2026omniscienceAccuracy
- AA-Omniscience · Non-hallucination2.60Oct 7, 2026omniscienceNonHallucination
More results
Benchmarks outside the capability baskets. They are not ranked against a leader.
- livebench_language31.27Aug 23, 2026livebench_language@2025-04-07
- AA Intelligence4.00Jul 3, 2026Artificial Analysis Intelligence Index
- vectara_avg_summary_length89.70May 2, 2026Average Summary Length (Words)
- vectara_answer_rate97.40May 2, 2026Answer Rate
- vectara_factual_consistency95.60May 2, 2026Factual Consistency Rate
- AA Intelligence3.75Oct 7, 2026aa_intelligence_index
Show 48 more resultsHide 48 results
- 0.14Sep 9, 2026
- -77.07Oct 7, 2026
- 84.20Oct 6, 2026
- 78.10Jun 5, 2026
- 43.60Jun 5, 2026
- Artificial Analysis Coding Index5.79Sep 9, 2026aa_coding_index
- BBH85.70Oct 6, 2026BIG-Bench Hard
- 16.30Oct 6, 2026
- 50.30Jun 5, 2026
- 75.70Oct 6, 2026
- 87.10Oct 6, 2026
- 56.90Jun 5, 2026
- 69.50Oct 6, 2026
- 94.40Oct 6, 2026
- 85.40Oct 6, 2026
- 88.90Aug 31, 2026
- 64.90Oct 6, 2026
- 43.80Jun 5, 2026
- 24.60Aug 23, 2026
- 51.50Jun 5, 2026
- 85.40Jun 5, 2026
- MATH-Vision32.10Jun 5, 2026MATH-Vision (Pass@1)
- 32.10Jun 5, 2026
- 73.00Oct 6, 2026
- 52.30Jun 5, 2026
- 6.70Jun 5, 2026
- 74.60Jun 5, 2026
- 21.30Jun 5, 2026
- 60.60Oct 6, 2026
- MMMU (val) (Pass@1)59.60Oct 6, 2026MMMU (val)
- 59.60Jun 5, 2026
- 56.10Jun 5, 2026
- 64.90Jun 5, 2026
- 64.90Jun 5, 2026
- MMVU57.00Jun 5, 2026MMVU (Pass@1)
- 57.00Jun 5, 2026
- 702.00Jun 5, 2026
- 59.10Jun 5, 2026
- 6.30Oct 6, 2026
- 67.70Oct 6, 2026
- 28.60Jun 5, 2026
- 58.20Jun 5, 2026
- VideoMME (w sub.)62.10Jun 5, 2026Video-MME (w/ sub.)
- VideoMMMU57.00Jun 5, 2026VideoMMMU (Pass@1)
- VideoMMMU57.20Jun 5, 2026VideoMMMU (Pass@1)
- 32.40Jun 5, 2026
- 63.20Jun 5, 2026
- τ²-Bench Telecom (AA run)10.82Oct 7, 2026aa_tau2
Gemma 3 12B: common questions
Who makes Gemma 3 12B?
Gemma 3 12B is made by Google.
When was Gemma 3 12B released?
Gemma 3 12B was released on Mar 12, 2025, according to Artificial Analysis.
What is Gemma 3 12B good at?
Gemma 3 12B is behind the leaders in multimodal tasks. Too few results yet to rate reasoning, coding, agentic tasks, safety, long context, math, multilingual tasks, instruction following, or factuality.
How much does Gemma 3 12B cost?
Gemma 3 12B costs $0.05 per million input tokens and $0.15 per million output tokens, according to deepinfra. We track its price at 2 providers. At a mix of three input tokens to one output token, it is cheaper than 93% of the 329 priced models we track.
How many benchmarks has Gemma 3 12B been tested on?
We track 75 results for Gemma 3 12B on 68 benchmarks from 9 sources, 6 of them independently verified. The latest was recorded on Oct 7, 2026.
Which API features does Gemma 3 12B support?
OpenRouter lists tool calling and structured outputs for Gemma 3 12B.
About this record
Where Gemma 3 12B's numbers come from, and every name it appears under.
- Tracked since
- May 29, 2026
- Newest source mention
- Aug 15, 2026
Where the results come from
Verification: 75 scores · 6 independently verified · 19 aggregator-attributed · 32 vendor cross-reference · 18 vendor-reported. How these tiers are assigned
From 9 sources on 4 sites. Hugging Face supplies 33 of them; the 6 independently verified results come from 3 sites. Bars are coloured by trust tier.
- huggingface.co33
- artificialanalysis.ai20
- api.llm-stats.com18
- raw.githubusercontent.com4