| Benchmark | Claude Sonnet 4.5 | Qwen3.6 27B |
|---|---|---|
| AA Agentic Index | 50.6 | 27.5 |
| AA Intelligence | 37.4 | 37.7 |
| AA-LCR | 68.3 | 73.3 |
| AA-Omniscience | -0.1 | -20 |
| Artificial Analysis Coding Index | 52.1 | 53.7 |
| CC-OCR | 68.1 | 81.2 |
| charxiv_rq | 67.2 | 78.4 |
| critpt | 1.1 | 1.1 |
| gdpval | 40.4 | 32 |
| GPQA Diamond | 83.4 | 87.8 |
| HLE | 19.8 | 24 |
| HMMT 2025 | 74.6 | 90.7 |
| hmmt_feb_2025 | 79.2 | 93.8 |
| hmmt_nov_2025 | 81.7 | 90.7 |
| IFBench | 57.3 | 69.1 |
| imo_answer_bench | 65.9 | 80.8 |
| LiveCodeBench v6 | 64 | 83.9 |
| MathVista | 79.8 | 87.4 |
| MMBench EN-DEV-v1.1 | 88.3 | 92.3 |
| mmlu_redux | 95.6 | 93.5 |
| MMLU-Pro | 88.2 | 86.2 |
| MMMU | 79.6 | 82.9 |
| MMMU-Pro | 68.7 | 75.8 |
| OmniDocBench 1.5 | 85.8 | 89.4 |
| OmniScience Accuracy | 32.9 | 19.6 |
| OmniScience Non-Hallucination | 50.9 | 50.7 |
| OSWorld-Verified | 61.4 | 63.9 |
| RealWorldQA | 70.3 | 84.1 |
| scicode | 45 | 39.8 |
| SimpleVQA | 57.6 | 56.1 |
| SWE-bench Multilingual | 68 | 71.3 |
| SWE-bench Pro | 43.6 | 53.5 |
| SWE-bench Verified | 82 | 77.2 |
| TauBench V3 - Banking | 24.5 | 16.7 |
| Terminal-Bench 2.0 | 50 | 59.3 |
| Terminal-Bench 2.1 | 55.8 | 60.7 |
| Terminal-Bench Hard | 35.6 | 34.8 |
| τ²-Bench Telecom (AA run) | 78.1 | 94.2 |
| τ³-Bench | 19 | 15.3 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.