Which is better, Claude Opus 4.5 or Gemma 4 31B?

Across 61 shared benchmarks tracked on Vector Wire, Claude Opus 4.5 leads on 53 and Gemma 4 31B leads on 8 — Claude Opus 4.5 leads on more. Strengths differ by axis; the table below shows every head-to-head number with provenance.

SEEDRefresh Models —Deals —Regulatory —Sources —

Claude Opus 4.5 vs Gemma 4 31B

AnthropicvsGoogle61 shared benchmarks53–8 head-to-head

Benchmark	Claude Opus 4.5	Gemma 4 31B
AA Agentic Index	59.6	14.4
AA Intelligence	41.9	29.7
AA-LCR	76	68.3
AA-Omniscience	14	-47.9
aime_2026	95.1	89.2
arena_elo	1473	1451
arena_text_factuality	1458	1449
Artificial Analysis Coding Index	47.8	43.4
C-Eval	92.2	82.6
CC-OCR	76.9	75.7
charxiv_rq	68.5	67.9
Claw Eval (pass@3)	59.6	25
Claw-Eval Avg	76.6	48.5
coding_arena_elo	1495	1364
critpt	4.6	1.4
DynaMath	79.7	79.5
ERQA	46.8	57.5
gdpval	47.3	15.5
GPQA Diamond	87	85.7
HLE	30.8	26.5
HLE (with tools)	43.4	26.5
hmmt_feb_2025	92.9	88.7
hmmt_feb_2026	85.3	77.2
hmmt_nov_2025	93.3	87.5
IFBench	58	75.6
imo_answer_bench	84	74.5
LiveCodeBench v6	84.8	80
mathvision	77.1	85.6
MathVista	80.2	79.3
MCP Atlas	69.8	57.2
mmlu_redux	95.6	93.7
MMLU-Pro	90	85.2
mmmlu	90.8	88.4
MMMU	80.7	80.4
MMMU-Pro	74	76.9
MMStar	73.2	77.3
nl2repo	43.2	15.5
OCRBench	86.5	86.1
OmniDocBench 1.5	87.7	80.1
OmniScience Accuracy	46.6	20
OmniScience Non-Hallucination	39	18.1
QwenClawBench	52.3	41.7
QwenWebBench	1536	1197
RealWorldQA	77	72.3
scicode	50	43.4
simpleqa_verified	41.8	9.6
SimpleVQA	69.7	52.9
SkillsBench Avg5	45.3	23.6
supergpqa	70.6	65.7
SWE-bench Multilingual	77.5	51.7
SWE-bench Pro	57.1	35.7
SWE-bench Verified	81.5	52
Terminal-Bench 2.0	59.3	42.9
Terminal-Bench Hard	47	36.4
tool_decathlon	43.5	21.2
vectara_answer_rate	98.7	100
vectara_avg_summary_length	114.5	75.8
vectara_factual_consistency	89.1	92.6
vectara_hallucination_rate ↓	10.9	7.4
τ²-Bench	98.2	76.9
τ²-Bench Telecom (AA run)	89.5	65.5

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.