| Benchmark | Claude Sonnet 4.5 | Gemini 3.5 Flash |
|---|---|---|
| AA Agentic Index | 50.6 | 70.4 |
| AA Intelligence | 37.4 | 52 |
| AA-LCR | 68.3 | 81 |
| AA-Omniscience | -0.1 | 21.2 |
| arc_agi_1 | 63.7 | 92.5 |
| ARC-AGI-2 | 13.6 | 72.1 |
| arena_elo | 1456 | 1477 |
| arena_text_factuality | 1448 | 1466 |
| Artificial Analysis Coding Index | 52.1 | 70.1 |
| charxiv_rq | 67.2 | 84.2 |
| coding_arena_elo | 1392 | 1490 |
| critpt | 1.1 | 13.1 |
| frontiermath_tier_4 | 4.2 | 14.6 |
| gdpval | 40.4 | 57.8 |
| GPQA Diamond | 83.4 | 92.2 |
| HLE | 19.8 | 42.7 |
| IFBench | 57.3 | 76.3 |
| matharena_visual_math_overall | 75.8 | 89.9 |
| MCP Atlas | 59.5 | 83.6 |
| MMMU-Pro | 68.7 | 84.3 |
| OmniScience Accuracy | 32.9 | 51.4 |
| OmniScience Non-Hallucination | 50.9 | 38.2 |
| OSWorld-Verified | 61.4 | 78.4 |
| scicode | 45 | 53.1 |
| simplebench | 54.3 | 76.7 |
| simpleqa_verified | 23.6 | 68.4 |
| SWE-bench Pro | 43.6 | 55.1 |
| TauBench V3 - Banking | 24.5 | 32.2 |
| Terminal-Bench 2.0 | 50 | 76.2 |
| Terminal-Bench 2.1 | 55.8 | 78.7 |
| Terminal-Bench Hard | 35.6 | 46.2 |
| toolathlon | 41 | 56.5 |
| τ²-Bench Telecom (AA run) | 78.1 | 95.6 |
| τ³-Bench | 19 | 25.4 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.