SWE-bench Verified — The canonical SWE-bench Verified (500-task human-filtered); raws incl. "SWE Verified (Resolved)"
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Opus 5 | Anthropic | 96 | 1 | 2026-07-24 |
| 2 | Claude Mythos 5 | Anthropic | 95.5 | 3 | 2026-08-23 |
| 3 | Claude Fable 5 | Anthropic | 95 | 4 | 2026-08-23 |
| 4 | GPT-5.6 Luna | OpenAI | 93 | 2 | 2026-07-30 |
| 5 | Claude Opus 4.8 | Anthropic | 88.6 | 4 | 2026-08-23 |
| 6 | Claude Opus 4.7 | Anthropic | 87.6 | 5 | 2026-08-23 |
| 7 | Claude Sonnet 5 | Anthropic | 85.2 | 3 | 2026-08-23 |
| 8 | Claudes | Anthropic | 85.2 | 1 | 2026-08-12 |
| 9 | Claude Sonnet 4.5 | Anthropic | 82 | 9 | 2026-07-29 |
| 10 | Claude Opus 4.5 | Anthropic | 81.5 | 10 | 2026-08-23 |
| 11 | Claude Opus 4.6 | Anthropic | 80.8 | 10 | 2026-08-23 |
| 12 | DeepSeek-V4-Pro | DeepSeek | 80.6 | 11 | 2026-08-23 |
| 13 | GPT-5.5 | OpenAI | 80.6 | 1 | 2026-06-01 |
| 14 | Gemini 3.1 Pro | 80.6 | 14 | 2026-08-24 | |
| 15 | MiniMax M3 | MiniMax | 80.5 | 1 | 2026-08-23 |
| 16 | Qwen3.7 Max | Alibaba | 80.4 | 1 | 2026-08-23 |
| 17 | Claude Sonnet 4 | Anthropic | 80.2 | 4 | 2026-08-23 |
| 18 | MiniMax M2.5 | MiniMax | 80.2 | 3 | 2026-08-23 |
| 19 | Inkling-Small | Thinking Machines | 80.2 | 3 | 2026-08-23 |
| 20 | Kimi K2.6 | Moonshot | 80.2 | 7 | 2026-08-23 |
| 21 | GPT-5.2 | OpenAI | 80 | 6 | 2026-08-23 |
| 22 | MiniMax M2.7 | MiniMax | 79.9 | 2 | 2026-07-30 |
| 23 | Claude Sonnet 4.6 | Anthropic | 79.6 | 2 | 2026-08-23 |
| 24 | Claude 4 Opus | Anthropic | 79.4 | 6 | 2026-08-23 |
| 25 | DeepSeek-V4-Flash | DeepSeek | 79 | 6 | 2026-07-30 |
| 26 | MiMo V2.5 Pro | Xiaomi | 78.9 | 4 | 2026-08-23 |
| 27 | Qwen3.6 Plus | Alibaba | 78.8 | 1 | 2026-08-23 |
| 28 | MiMo V2 Pro | Xiaomi | 78 | 1 | 2026-08-23 |
| 29 | Gemini 3 Pro | 78 | 13 | 2026-08-23 | |
| 30 | Hy3-preview | Tencent | 78 | 1 | 2026-08-23 |
| 31 | Hunyuan Hy3 | Tencent | 78 | 1 | 2026-07-14 |
| 32 | Gemini 3 Flash Preview | 78 | 1 | 2026-08-23 | |
| 33 | GPT-5.1 Codex Max | OpenAI | 77.9 | 3 | 2026-06-15 |
| 34 | GLM-5 | Z.ai | 77.8 | 2 | 2026-08-23 |
| 35 | Qwen3.7 Plus Preview | Alibaba | 77.7 | 1 | 2026-08-23 |
| 36 | Inkling | Thinking Machines | 77.6 | 3 | 2026-07-30 |
| 37 | Mistral Medium 3.5 128B | Mistral | 77.6 | 1 | 2026-05-03 |
| 38 | Muse Spark | Meta | 77.4 | 1 | 2026-08-23 |
| 39 | Qwen3.6 27B | Alibaba | 77.2 | 2 | 2026-08-23 |
| 40 | Kimi K2.5 | Moonshot | 76.8 | 8 | 2026-08-23 |
| 41 | GPT-5.4 nano | OpenAI | 76.4 | 1 | 2026-05-17 |
| 42 | Qwen3.5 397B A17B | Alibaba | 76.4 | 4 | 2026-08-23 |
| 43 | GPT-5.1 | OpenAI | 76.3 | 3 | 2026-08-23 |
| 44 | GPT-5.1 Instant | OpenAI | 76.3 | 1 | 2026-08-23 |
| 45 | GLM-5.1-744B-A40B | Z.ai | 76.2 | 1 | 2026-06-06 |
| 46 | muse-glimmer-30b | Meta | 76 | 1 | 2026-08-23 |
| 47 | Kimi K2.6 1T A32B | Moonshot | 75.7 | 1 | 2026-06-06 |
| 48 | MiniMax 2.7 230B A10B | MiniMax | 75.3 | 1 | 2026-06-06 |
| 49 | Qwen3.5 27B | Alibaba | 75 | 4 | 2026-08-23 |
| 50 | Gemini 3.5 Flash Lite | 75 | 2 | 2026-07-30 | |
| 51 | GPT-5 | OpenAI | 74.9 | 4 | 2026-08-23 |
| 52 | MiMo V2 Omni | Xiaomi | 74.8 | 1 | 2026-08-23 |
| 53 | GPT-5 Codex | OpenAI | 74.5 | 1 | 2026-08-23 |
| 54 | Claude Opus 4.1 | Anthropic | 74.5 | 3 | 2026-08-23 |
| 55 | Step 3.5 Flash | StepFun | 74.4 | 4 | 2026-08-23 |
| 56 | MiniMax M2.1 | MiniMax | 74 | 5 | 2026-08-23 |
| 57 | GLM-4.7 | Z.ai | 73.8 | 6 | 2026-08-23 |
| 58 | GPT-5.1 Codex | OpenAI | 73.7 | 3 | 2026-08-23 |
| 59 | Qwen 3.5 397B 17B | Alibaba | 73.6 | 1 | 2026-06-06 |
| 60 | MAI-Thinking-1 | Microsoft | 73.5 | 2 | 2026-08-23 |
| 61 | Qwen3.6 35B A3B | Alibaba | 73.4 | 4 | 2026-08-23 |
| 62 | MiMo V2 Flash | Xiaomi | 73.4 | 6 | 2026-08-23 |
| 63 | Claude Haiku 4.5 | Anthropic | 73.3 | 1 | 2026-08-23 |
| 64 | DeepSeek-V3.2-Speciale | DeepSeek | 73.1 | 1 | 2026-08-23 |
| 65 | DeepSeek-V3.2 | DeepSeek | 73.1 | 15 | 2026-08-23 |
| 66 | Devstral 2 | Mistral | 72.2 | 2 | 2026-06-15 |
| 67 | Qwen3.5 122B A10B | Alibaba | 72 | 1 | 2026-08-23 |
| 68 | MAI-Code-1-Flash | Microsoft | 71.6 | 1 | 2026-08-23 |
| 69 | Kimi K2 (Reasoning) | Moonshot | 71.3 | 12 | 2026-06-15 |
| 70 | Laguna-XS-2.1 | poolside | 70.9 | 1 | 2026-08-23 |
| 71 | Grok Code Fast 1 | SpaceXAI | 70.8 | 1 | 2026-08-23 |
| 72 | nvidia-nemotron-3-ultra-550b-a55b | NVIDIA | 70.7 | 1 | 2026-08-24 |
| 73 | Nemotron 3 Ultra 550B A55B | NVIDIA | 70.7 | 1 | 2026-06-06 |
| 74 | Solar Pro4 | Upstage | 70.6 | 1 | 2026-08-23 |
| 75 | Claude 3.7 Sonnet | Anthropic | 70.3 | 2 | 2026-08-23 |
| 76 | Qwen3.5 35B A3B | Alibaba | 70 | 2 | 2026-08-23 |
| 77 | Qwen3 Coder 480B A35B Instruct | Alibaba | 69.6 | 3 | 2026-08-23 |
| 78 | Qwen3 Max (Reasoning) | Alibaba | 69.6 | 1 | 2026-08-23 |
| 79 | Qwen3 Coder Plus | Alibaba | 69.6 | 2 | 2026-06-15 |
| 80 | MiniMax M2 | MiniMax | 69.4 | 5 | 2026-08-23 |
| 81 | o3 | OpenAI | 69.1 | 3 | 2026-08-23 |
| 82 | GLM-4.6 | Z.ai | 68.2 | 6 | 2026-08-23 |
| 83 | o4-mini | OpenAI | 68.1 | 1 | 2026-08-23 |
| 84 | Devstral Small 2 | Mistral | 68 | 2 | 2026-06-15 |
| 85 | DeepSeek-V3.2-Exp | DeepSeek | 67.8 | 1 | 2026-08-23 |
| 86 | North-Mini-Code-1.0 | Cohere | 67.6 | 2 | 2026-08-23 |
| 87 | Gemini 2.5 Pro | 67.2 | 3 | 2026-08-23 | |
| 88 | Gemini 2.5 Pro Preview 06.05 (32k think) | 67.2 | 3 | 2026-08-24 | |
| 89 | DeepSeek-V3.1 | DeepSeek | 66 | 2 | 2026-08-23 |
| 90 | K2-Instruct-0711 | Moonshot | 65.8 | 1 | 2026-05-15 |
| 91 | Kimi K2 Instruct | Moonshot | 65.8 | 2 | 2026-08-23 |
| 92 | GLM-4.5 | Z.ai | 64.2 | 4 | 2026-08-23 |
| 93 | Nemotron 3 Super | NVIDIA | 63.1 | 1 | 2026-08-11 |
| 94 | Devstral Medium | Mistral | 61.6 | 1 | 2026-08-23 |
| 95 | Gemini 2.5 Flash | 60.4 | 1 | 2026-08-23 | |
| 96 | GLM-4.7-Flash | Z.ai | 59.2 | 2 | 2026-08-23 |
| 97 | Nemotron CORTEXA | NVIDIA | 58.2 | 1 | 2026-05-01 |
| 98 | DeepSeek-R1 | DeepSeek | 57.6 | 15 | 2026-08-23 |
| 99 | GLM-4.5-Air | Z.ai | 57.6 | 1 | 2026-08-23 |
| 100 | Gemma 4 26B A4B | 57.4 | 2 | 2026-08-11 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.