| Benchmark | Claude Sonnet 4.5 | DeepSeek-V4-Flash |
|---|---|---|
| AA Agentic Index | 50.6 | 61.3 |
| AA Intelligence | 37.4 | 51.8 |
| AA-LCR | 68.3 | 74.3 |
| AA-Omniscience | -0.1 | -14.3 |
| arc_agi_1 | 63.7 | 84 |
| ARC-AGI-2 | 13.6 | 46 |
| arena_elo | 1456 | 1439 |
| arena_text_factuality | 1448 | 1434 |
| Artificial Analysis Coding Index | 52.1 | 69.1 |
| browsecomp | 24.1 | 73.2 |
| BrowseComp (context management) | 26.1 | 73.2 |
| coding_arena_elo | 1392 | 1431 |
| critpt | 1.1 | 16.6 |
| gdpval | 40.4 | 52.9 |
| GPQA Diamond | 83.4 | 90.8 |
| HLE | 19.8 | 38.6 |
| HLE (with tools) | 32 | 45.1 |
| IFBench | 57.3 | 79.2 |
| imo_answer_bench | 65.9 | 88.4 |
| LiveCodeBench | 71 | 91.6 |
| MCP Atlas | 59.5 | 69 |
| MMLU-Pro | 88.2 | 86.4 |
| OmniScience Accuracy | 32.9 | 40.4 |
| OmniScience Non-Hallucination | 50.9 | 15.6 |
| scicode | 45 | 49.9 |
| simplebench | 54.3 | 46.3 |
| simpleqa_verified | 23.6 | 45 |
| SWE-bench Multilingual | 68 | 73.3 |
| SWE-bench Pro | 43.6 | 52.6 |
| SWE-bench Verified | 82 | 79 |
| TauBench V3 - Banking | 24.5 | 39.4 |
| Terminal-Bench 2.0 | 50 | 56.9 |
| Terminal-Bench 2.1 | 55.8 | 82.7 |
| Terminal-Bench Hard | 35.6 | 38.6 |
| toolathlon | 41 | 70.3 |
| τ²-Bench Telecom (AA run) | 78.1 | 95.6 |
| τ³-Bench | 19 | 22.9 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.