Which is better, Claude Sonnet 4 or Gemini 2.5 Pro?

Across 59 shared benchmarks tracked on Vector Wire, Claude Sonnet 4 leads on 27 and Gemini 2.5 Pro leads on 31 — Gemini 2.5 Pro leads on more. Strengths differ by axis; the table below shows every head-to-head number with provenance.

SEEDRefresh Models —Deals —Regulatory —Sources —

Claude Sonnet 4 vs Gemini 2.5 Pro

AnthropicvsGoogle59 shared benchmarks27–31 head-to-head

Benchmark	Claude Sonnet 4	Gemini 2.5 Pro
AA Agentic Index	39.2	7.2
AA Intelligence	29.8	27
AA-LCR	69.7	66
AA-Omniscience	0.2	-14.3
aider_polyglot	70.7	82.2
AIME 2025	74	88.3
AIR-Bench 2024	88.3	73.6
anthropic_red_team	99.2	99.5
arc_agi_1	63.7	41
ARC-AGI-2	13.6	4.9
arena_vision	1207	1246
ArtifactsBench	57.3	57.7
Artificial Analysis Coding Index	37.6	46.7
bbq	97.9	96.4
browsecomp	12.2	9.9
browsecomp_zh	29.1	32.2
critpt	1.1	2.6
FinSearchComp-global	42	42.6
Fortress	24.4	54.9
frontiermath_tier_4	0	4.2
GAIA (text only)	68.3	60.2
gdpval	31.2	8.5
GPQA Diamond	78	84.4
harmbench	98	65.4
HLE	10.7	22.5
HLE (with tools)	20.3	28.4
HMMT 2025	15.9	65.7
IFBench	55	49
LiveCodeBench	68.5	82.7
livecodebench_easy	98.8	98.8
livecodebench_hard	32.6	59.4
livecodebench_medium	76	90.6
MMLU-Pro	84	86
MMMU	74.4	83.9
MMMU-Pro	62.4	74.9
multichallenge	57.1	53.6
OmniScience Accuracy	22.7	39
OmniScience Non-Hallucination	70.9	12.6
scicode	40	43
SEAL VISTA	45.5	50.8
simple_safety_tests	100	97
simplebench	45.5	62.4
simpleqa	15.9	50.8
swe_bench_bash	64.9	53.6
SWE-bench Verified	80.2	67.2
TauBench V3 - Banking	16.7	9.7
Terminal-Bench	36.4	25.3
Terminal-Bench 2.1	36.3	28.5
Terminal-Bench Hard	31.1	26.5
theagentcompany	37	39.3
vectara_answer_rate	98.6	99.1
vectara_avg_summary_length	145.8	106.4
vectara_factual_consistency	89.7	93
vectara_hallucination_rate ↓	10.3	7
xbench_deepsearch	64.6	56
xstest	97.2	98.7
τ²-Bench	65	54
τ²-Bench Telecom (AA run)	64.6	54.1
τ³-Bench	13.8	9.3

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.