SWE-bench Multilingual — Official multilingual split; variants agent-mode/agentic-coding
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Claude Mythos 5 | Anthropic | 92.2 | 2 | 2026-08-23 |
| 2 | Opus 5 | Anthropic | 89.5 | 1 | 2026-07-24 |
| 3 | Claude Fable 5 | Anthropic | 86.6 | 1 | 2026-07-24 |
| 4 | Claude Opus 4.8 | Anthropic | 84.4 | 3 | 2026-08-23 |
| 5 | Claude Opus 4.7 | Anthropic | 80.5 | 3 | 2026-06-21 |
| 6 | laguna-s-2.1 | poolside | 78.5 | 2 | 2026-08-23 |
| 7 | Qwen3.7 Max | Alibaba | 78.3 | 1 | 2026-08-23 |
| 8 | Claudes | Anthropic | 78.3 | 1 | 2026-08-12 |
| 9 | Claude Sonnet 5 | Anthropic | 78.3 | 3 | 2026-08-23 |
| 10 | Claude Opus 4.6 | Anthropic | 77.8 | 9 | 2026-08-23 |
| 11 | Claude Opus 4.5 | Anthropic | 77.5 | 9 | 2026-08-10 |
| 12 | Kimi K2.6 1T A32B | Moonshot | 77.1 | 1 | 2026-06-06 |
| 13 | Gemini 3.1 Pro | 76.9 | 2 | 2026-05-03 | |
| 14 | Kimi K2.6 | Moonshot | 76.7 | 8 | 2026-08-23 |
| 15 | MiniMax M2.7 | MiniMax | 76.5 | 1 | 2026-08-23 |
| 16 | DeepSeek-V4-Pro | DeepSeek | 76.2 | 10 | 2026-08-23 |
| 17 | Hy3-preview | Tencent | 75.8 | 1 | 2026-08-23 |
| 18 | Qwen3.7 Plus Preview | Alibaba | 75.8 | 1 | 2026-08-23 |
| 19 | GLM-5.1-744B-A40B | Z.ai | 74.8 | 1 | 2026-06-06 |
| 20 | Qwen3.6 Plus | Alibaba | 73.8 | 1 | 2026-08-23 |
| 21 | GLM-5 | Z.ai | 73.3 | 2 | 2026-05-17 |
| 22 | GLM-5.1 | Z.ai | 73.3 | 4 | 2026-06-15 |
| 23 | DeepSeek-V4-Flash | DeepSeek | 73.3 | 4 | 2026-06-27 |
| 24 | Kimi K2.5 | Moonshot | 73 | 5 | 2026-08-23 |
| 25 | Gemini 3 Flash Preview | 72.7 | 1 | 2026-05-01 | |
| 26 | MiniMax M2.1 | MiniMax | 72.5 | 2 | 2026-08-23 |
| 27 | GPT-5.2 | OpenAI | 72 | 4 | 2026-06-15 |
| 28 | MiniMax 2.7 230B A10B | MiniMax | 71.8 | 1 | 2026-06-06 |
| 29 | MiMo V2 Pro | Xiaomi | 71.7 | 1 | 2026-08-23 |
| 30 | MiMo V2 Flash | Xiaomi | 71.7 | 3 | 2026-08-23 |
| 31 | GPT-5.4 | OpenAI | 71.7 | 2 | 2026-06-15 |
| 32 | Qwen3.6 27B | Alibaba | 71.3 | 2 | 2026-08-23 |
| 33 | Qwen 3.5 397B 17B | Alibaba | 70.9 | 1 | 2026-06-06 |
| 34 | DeepSeek-V3.2 | DeepSeek | 70.2 | 12 | 2026-08-23 |
| 35 | Qwen3.5 27B | Alibaba | 69.3 | 2 | 2026-06-15 |
| 36 | Qwen3.5 397B A17B | Alibaba | 69.3 | 2 | 2026-08-23 |
| 37 | Gemini 3 Pro | 68.7 | 4 | 2026-08-24 | |
| 38 | MiniMax M2.5 | MiniMax | 68.3 | 1 | 2026-05-01 |
| 39 | Claude Sonnet 4.5 | Anthropic | 68 | 11 | 2026-08-10 |
| 40 | Nemotron 3 Ultra 550B A55B | NVIDIA | 67.7 | 1 | 2026-06-06 |
| 41 | nvidia-nemotron-3-ultra-550b-a55b | NVIDIA | 67.7 | 1 | 2026-08-24 |
| 42 | Qwen3.6 35B A3B | Alibaba | 67.2 | 4 | 2026-08-23 |
| 43 | GLM-4.7 | Z.ai | 66.7 | 3 | 2026-08-23 |
| 44 | GPT-5.2 Codex | OpenAI | 66.3 | 1 | 2026-05-01 |
| 45 | MAI-Code-1-Flash | Microsoft | 65.5 | 1 | 2026-08-23 |
| 46 | Claude Haiku 4.5 | Anthropic | 64.7 | 1 | 2026-05-01 |
| 47 | Laguna-XS-2.1 | poolside | 63.1 | 1 | 2026-08-23 |
| 48 | Devstral 2 | Mistral | 61.3 | 2 | 2026-06-15 |
| 49 | Kimi K2 (Reasoning) | Moonshot | 61.1 | 9 | 2026-06-15 |
| 50 | Qwen3.5 35B A3B | Alibaba | 60.3 | 1 | 2026-05-03 |
| 51 | DeepSeek-V3.2-Exp | DeepSeek | 57.9 | 1 | 2026-08-23 |
| 52 | Claude Sonnet 4 | Anthropic | 56.9 | 2 | 2026-06-06 |
| 53 | MiniMax M2 | MiniMax | 56.5 | 5 | 2026-08-23 |
| 54 | Devstral Small 2 | Mistral | 55.7 | 2 | 2026-06-15 |
| 55 | GPT-5 | OpenAI | 55.3 | 2 | 2026-05-18 |
| 56 | Qwen3 Coder Plus | Alibaba | 54.7 | 2 | 2026-06-15 |
| 57 | Qwen3 Coder 480B A35B Instruct | Alibaba | 54.7 | 2 | 2026-08-23 |
| 58 | DeepSeek-V3.1 | DeepSeek | 54.5 | 2 | 2026-08-23 |
| 59 | GLM-4.6 | Z.ai | 53.8 | 2 | 2026-06-06 |
| 60 | GLM-4.5 | Z.ai | 52.7 | 1 | 2026-05-15 |
| 61 | Gemma 4 31B | 51.7 | 2 | 2026-06-15 | |
| 62 | Nemotron 3 Super | NVIDIA | 49.8 | 1 | 2026-08-11 |
| 63 | Kimi K2 Instruct | Moonshot | 47.3 | 2 | 2026-08-23 |
| 64 | K2-Instruct-0711 | Moonshot | 47.3 | 1 | 2026-05-15 |
| 65 | Nemotron 3 Super 120B A12B | NVIDIA | 45.8 | 1 | 2026-08-23 |
| 66 | Gemma 4 26B A4B | 43.4 | 2 | 2026-08-11 | |
| 67 | gpt-oss-20b | OpenAI | 41.9 | 1 | 2026-08-11 |
| 68 | GPT-5 mini | OpenAI | 39.7 | 1 | 2026-05-01 |
| 69 | Nemotron 3.5 Lightning | NVIDIA | 39.3 | 1 | 2026-08-11 |
| 70 | LongCat Flash Lite | Meituan | 38.1 | 1 | 2026-08-23 |
| 71 | DeepSeek-R1 | DeepSeek | 30.5 | 1 | 2026-08-23 |
| 72 | Nemotron 3 Nano | NVIDIA | 14.1 | 1 | 2026-08-11 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.