SWE-bench Pro — DeepSeek-card naming "(Resolved)"=standard SWE-bench Pro metric; matches swe_bench_pro range/raws
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | MAI-Thinking-1 | Microsoft | 95.4 | 2 | 2026-08-23 |
| 2 | Claude Mythos 5 | Anthropic | 80.3 | 3 | 2026-08-23 |
| 3 | Claude Fable 5 | Anthropic | 80 | 5 | 2026-08-23 |
| 4 | Opus 5 | Anthropic | 79.2 | 1 | 2026-07-24 |
| 5 | Claude Opus 4.8 | Anthropic | 69.2 | 9 | 2026-08-23 |
| 6 | Qwen3.8 Max Preview | Alibaba | 67.7 | 2 | 2026-08-23 |
| 7 | Grok4.5 | SpaceXAI | 64.7 | 2 | 2026-08-23 |
| 8 | GPT-5.6 Sol | OpenAI | 64.6 | 3 | 2026-08-23 |
| 9 | Claude Opus 4.7 | Anthropic | 64.3 | 6 | 2026-08-23 |
| 10 | GPT-5.6 Terra | OpenAI | 63.4 | 1 | 2026-08-23 |
| 11 | Claude Sonnet 5 | Anthropic | 63.2 | 3 | 2026-08-23 |
| 12 | GPT-5.6 Luna | OpenAI | 62.7 | 2 | 2026-08-23 |
| 13 | GLM-5.2 Full Open Source | Z.ai | 62.1 | 5 | 2026-08-23 |
| 14 | Qwen3.8 27B | Alibaba | 61.7 | 2 | 2026-08-23 |
| 15 | Muse Spark 1.1 | Meta | 61.5 | 3 | 2026-08-23 |
| 16 | Qwen3.7 Max | Alibaba | 60.6 | 4 | 2026-08-23 |
| 17 | laguna-s-2.1 | poolside | 59.4 | 2 | 2026-08-23 |
| 18 | GPT-5.4 | OpenAI | 59.1 | 13 | 2026-08-23 |
| 19 | MiniMax M3 | MiniMax | 59 | 3 | 2026-08-23 |
| 20 | Gemini 3.6 Flash | 58.7 | 3 | 2026-08-24 | |
| 21 | GPT-5.5 | OpenAI | 58.6 | 8 | 2026-08-23 |
| 22 | Kimi K2.6 | Moonshot | 58.6 | 8 | 2026-08-23 |
| 23 | GLM-5.1 | Z.ai | 58.4 | 9 | 2026-08-23 |
| 24 | Claudes | Anthropic | 58.1 | 1 | 2026-08-12 |
| 25 | Claude Sonnet 4.6 | Anthropic | 58.1 | 2 | 2026-07-07 |
| 26 | Hunyuan Hy3 | Tencent | 57.9 | 1 | 2026-07-14 |
| 27 | Hy3-preview | Tencent | 57.9 | 1 | 2026-08-23 |
| 28 | Qwen3.7 Plus Preview | Alibaba | 57.6 | 2 | 2026-08-23 |
| 29 | Claude Opus 4.6 | Anthropic | 57.3 | 11 | 2026-08-14 |
| 30 | MiMo V2.5 Pro | Xiaomi | 57.2 | 2 | 2026-08-23 |
| 31 | Claude Opus 4.5 | Anthropic | 57.1 | 5 | 2026-07-29 |
| 32 | GPT-5.3 Codex | OpenAI | 56.8 | 2 | 2026-08-23 |
| 33 | Qwen3.6 Plus | Alibaba | 56.6 | 3 | 2026-08-23 |
| 34 | GPT-5.2 Codex | OpenAI | 56.4 | 3 | 2026-08-23 |
| 35 | MiniMax M2.7 | MiniMax | 56.2 | 3 | 2026-08-23 |
| 36 | Inkling-Small | Thinking Machines | 55.9 | 1 | 2026-08-23 |
| 37 | GPT-5.2 | OpenAI | 55.6 | 5 | 2026-06-21 |
| 38 | DeepSeek-V4-Pro | DeepSeek | 55.4 | 12 | 2026-08-23 |
| 39 | MiniMax M2.5 | MiniMax | 55.4 | 1 | 2026-08-23 |
| 40 | GLM-5 | Z.ai | 55.1 | 2 | 2026-05-18 |
| 41 | Gemini 3.5 Flash | 55.1 | 6 | 2026-08-24 | |
| 42 | Muse Spark | Meta | 55 | 3 | 2026-08-23 |
| 43 | GPT-5.4 mini | OpenAI | 54.4 | 1 | 2026-08-23 |
| 44 | Gemini 3.5 Flash Lite | 54.2 | 5 | 2026-08-24 | |
| 45 | Gemini 3.1 Pro | 54.2 | 19 | 2026-08-24 | |
| 46 | Kimi K2.5 | Moonshot | 53.8 | 5 | 2026-08-23 |
| 47 | Qwen3.6 27B | Alibaba | 53.5 | 3 | 2026-08-23 |
| 48 | DeepSeek-V4-Flash | DeepSeek | 52.6 | 4 | 2026-06-27 |
| 49 | GPT-5.4 nano | OpenAI | 52.4 | 1 | 2026-08-23 |
| 50 | muse-glimmer-30b | Meta | 51.2 | 2 | 2026-08-23 |
| 51 | Qwen3.5 27B | Alibaba | 51.2 | 2 | 2026-06-15 |
| 52 | MAI-Code-1-Flash | Microsoft | 51.2 | 2 | 2026-08-23 |
| 53 | Qwen3.5 397B A17B | Alibaba | 50.9 | 1 | 2026-06-15 |
| 54 | Gemini 3 Flash Preview | 49.6 | 7 | 2026-08-04 | |
| 55 | Qwen3.6 35B A3B | Alibaba | 49.5 | 3 | 2026-08-23 |
| 56 | Laguna-XS-2.1 | poolside | 47.6 | 1 | 2026-08-23 |
| 57 | Qwen3.5 35B A3B | Alibaba | 44.6 | 1 | 2026-05-03 |
| 58 | Claude Sonnet 4.5 | Anthropic | 43.6 | 2 | 2026-06-01 |
| 59 | Gemini 3 Pro | 43.3 | 3 | 2026-06-01 | |
| 60 | Claude Sonnet 4 | Anthropic | 42.7 | 3 | 2026-06-23 |
| 61 | GPT-5 | OpenAI | 41.8 | 1 | 2026-05-02 |
| 62 | North-Mini-Code-1.0 | Cohere | 40.2 | 1 | 2026-08-23 |
| 63 | Claude Haiku 4.5 | Anthropic | 39.5 | 3 | 2026-06-19 |
| 64 | Qwen3 Coder 480B A35B Instruct | Alibaba | 38.7 | 3 | 2026-06-19 |
| 65 | MiniMax M2.1 | MiniMax | 36.8 | 2 | 2026-06-01 |
| 66 | Gemma 4 31B | 35.7 | 2 | 2026-06-15 | |
| 67 | Kimi K2 Instruct | Moonshot | 27.7 | 2 | 2026-06-01 |
| 68 | Qwen3 235B A22B | Alibaba | 21.4 | 4 | 2026-06-20 |
| 69 | GPT OSS 120B | OpenAI | 16.2 | 3 | 2026-06-21 |
| 70 | DeepSeek-V3.2 | DeepSeek | 15.6 | 2 | 2026-06-01 |
| 71 | Gemma 4 26B A4B | 13.8 | 1 | 2026-05-03 | |
| 72 | Gemma 3 27B | 11.4 | 2 | 2026-06-01 | |
| 73 | Llama 3.1 Instruct 405B | Meta | 11.2 | 3 | 2026-06-19 |
| 74 | GLM-4.6 | Z.ai | 9.7 | 4 | 2026-06-20 |
| 75 | Llama 4 Maverick | Meta | 5.2 | 2 | 2026-06-01 |
| 76 | Codestral 2405 | Mistral | 1.5 | 2 | 2026-06-01 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.