MultiChallenge — Multi-turn instruction-following benchmark; large cross-vendor aggregate.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Muse Spark | Meta | 75.5 | 1 | 2026-05-13 |
| 2 | Muse Spark 1.1 | Meta | 75.3 | 1 | 2026-07-26 |
| 3 | Gemini 3.1 Pro | 71.4 | 1 | 2026-05-13 | |
| 4 | GPT-5 | OpenAI | 71.1 | 4 | 2026-08-23 |
| 5 | GPT-5.4 Pro | OpenAI | 69.2 | 1 | 2026-05-13 |
| 6 | Qwen3.5 397B A17B | Alibaba | 67.6 | 1 | 2026-08-23 |
| 7 | Kimi K2 (Reasoning) | Moonshot | 66.4 | 3 | 2026-06-25 |
| 8 | Gemini 3 Pro | 65.7 | 1 | 2026-05-13 | |
| 9 | Qwen 3.5 397B 17B | Alibaba | 63.9 | 1 | 2026-06-10 |
| 10 | nvidia-nemotron-3-ultra-550b-a55b | NVIDIA | 63.8 | 1 | 2026-08-24 |
| 11 | Nemotron 3 Ultra 550B A55B | NVIDIA | 63.8 | 1 | 2026-06-10 |
| 12 | GPT-5.1 | OpenAI | 63.4 | 1 | 2026-05-15 |
| 13 | Kimi K2.6 1T A32B | Moonshot | 63.1 | 1 | 2026-06-10 |
| 14 | GLM-5.1-744B-A40B | Z.ai | 63 | 1 | 2026-06-10 |
| 15 | Step3 VL 10B | StepFun | 62.6 | 1 | 2026-08-23 |
| 16 | o3-pro | OpenAI | 62.4 | 1 | 2026-05-15 |
| 17 | Qwen3.5 122B A10B | Alibaba | 61.5 | 1 | 2026-08-23 |
| 18 | Kimi K2.5 | Moonshot | 61.4 | 2 | 2026-06-19 |
| 19 | Qwen3.5 27B | Alibaba | 60.8 | 1 | 2026-08-23 |
| 20 | Gemini 3.1 Flash Lite Preview | 60.6 | 1 | 2026-05-15 | |
| 21 | o3 | OpenAI | 60.4 | 4 | 2026-08-23 |
| 22 | Qwen3 235B Thinking | Alibaba | 60.3 | 2 | 2026-06-25 |
| 23 | Qwen3.5 35B A3B | Alibaba | 60 | 1 | 2026-08-23 |
| 24 | GPT-5 mini | OpenAI | 59 | 1 | 2026-05-15 |
| 25 | Claude Opus 4.5 | Anthropic | 59 | 1 | 2026-05-15 |
| 26 | Claude 4 Opus | Anthropic | 58.6 | 5 | 2026-06-15 |
| 27 | Claude Opus 4.1 | Anthropic | 57.2 | 2 | 2026-06-01 |
| 28 | Claude Sonnet 4 | Anthropic | 57.1 | 3 | 2026-06-15 |
| 29 | Claude Opus 4.6 | Anthropic | 56 | 4 | 2026-06-19 |
| 30 | Claude Sonnet 4.5 | Anthropic | 55.3 | 1 | 2026-05-15 |
| 31 | Nemotron 3 Super 120B A12B | NVIDIA | 55.2 | 1 | 2026-08-23 |
| 32 | GLM-4.6 | Z.ai | 54.9 | 2 | 2026-06-25 |
| 33 | Qwen3.5 9B | Alibaba | 54.5 | 1 | 2026-08-23 |
| 34 | DeepSeek-V3.1-Terminus | DeepSeek | 54.4 | 2 | 2026-06-25 |
| 35 | Kimi K2 Instruct | Moonshot | 54.1 | 4 | 2026-08-23 |
| 36 | Gemini 2.5 Pro | 53.6 | 1 | 2026-05-15 | |
| 37 | MAI-Thinking-1 | Microsoft | 53 | 1 | 2026-08-23 |
| 38 | Gemini 2.5 Pro Preview 06.05 (32k think) | 51.8 | 2 | 2026-06-05 | |
| 39 | Claude 3.7 Sonnet | Anthropic | 51.6 | 1 | 2026-05-15 |
| 40 | GPT-5.1 Instant | OpenAI | 51.2 | 1 | 2026-05-15 |
| 41 | Claude Haiku 4.5 | Anthropic | 50.5 | 1 | 2026-06-01 |
| 42 | Qwen3.5 4B | Alibaba | 49 | 1 | 2026-08-23 |
| 43 | PaCoRe-8B | StepFun | 47 | 1 | 2026-06-25 |
| 44 | DeepSeek-V3.1 | DeepSeek | 46.1 | 1 | 2026-05-15 |
| 45 | GPT OSS 120B | OpenAI | 45.3 | 2 | 2026-06-01 |
| 46 | DeepSeek-R1 | DeepSeek | 45 | 4 | 2026-06-05 |
| 47 | o4-mini | OpenAI | 44.9 | 2 | 2026-08-23 |
| 48 | MiniMax M1 40K | MiniMax | 44.7 | 3 | 2026-08-23 |
| 49 | MiniMax M1 80K | MiniMax | 44.7 | 3 | 2026-08-23 |
| 50 | GPT-4.5 Preview | OpenAI | 43.8 | 1 | 2026-08-23 |
| 51 | MiniMax 2.7 230B A10B | MiniMax | 42.5 | 1 | 2026-06-10 |
| 52 | Qwen3 235B A22B | Alibaba | 41.2 | 6 | 2026-06-19 |
| 53 | GPT-4o | OpenAI | 40.3 | 1 | 2026-08-23 |
| 54 | o3-mini | OpenAI | 39.9 | 1 | 2026-08-23 |
| 55 | GPT-4.1 | OpenAI | 39.4 | 3 | 2026-08-23 |
| 56 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 38.5 | 1 | 2026-08-23 |
| 57 | Gemini 2.0 Flash (Non-Reasoning) | 36.4 | 2 | 2026-06-22 | |
| 58 | GPT-4.1 mini | OpenAI | 35.8 | 1 | 2026-08-23 |
| 59 | Qwen3.5 2B | Alibaba | 33.7 | 1 | 2026-08-23 |
| 60 | RLVR-8B | StepFun | 33.3 | 2 | 2026-06-25 |
| 61 | DeepSeek-V3 | DeepSeek | 31.4 | 2 | 2026-06-15 |
| 62 | Qwen3.5 0.8B | Alibaba | 18.9 | 1 | 2026-08-23 |
| 63 | GPT-4.1 nano | OpenAI | 15 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.