MMLU-Pro — Bucket (219 models); max=2000 is a data anomaly, not a diff-benchmark signal. Distinct MMLU family.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 3.1 Pro | 91 | 4 | 2026-07-04 | |
| 2 | Namazu | sakana | 90.3 | 1 | 2026-08-23 |
| 3 | Gemini 3 Pro | 90.1 | 5 | 2026-06-15 | |
| 4 | Claude Opus 4.5 | Anthropic | 90 | 3 | 2026-06-15 |
| 5 | Qwen3.7 Max | Alibaba | 89.6 | 1 | 2026-08-23 |
| 6 | Claude Opus 4.6 | Anthropic | 89.1 | 4 | 2026-07-04 |
| 7 | Qwen3.6 Plus | Alibaba | 88.5 | 1 | 2026-08-23 |
| 8 | Qwen3.7 Plus Preview | Alibaba | 88.5 | 1 | 2026-08-23 |
| 9 | Qwen 3.5 397B 17B | Alibaba | 88.3 | 1 | 2026-06-06 |
| 10 | Claude Sonnet 4.5 | Anthropic | 88.2 | 6 | 2026-06-12 |
| 11 | Kimi K2.6 1T A32B | Moonshot | 88.1 | 1 | 2026-06-06 |
| 12 | MiniMax M2.1 | MiniMax | 88 | 2 | 2026-08-23 |
| 13 | Qwen3.5 397B A17B | Alibaba | 87.8 | 2 | 2026-08-23 |
| 14 | DeepSeek-V4-Pro | DeepSeek | 87.5 | 11 | 2026-08-23 |
| 15 | GPT-5.4 | OpenAI | 87.5 | 4 | 2026-07-04 |
| 16 | GPT-5 | OpenAI | 87.5 | 4 | 2026-06-06 |
| 17 | Kimi K2.6 | Moonshot | 87.1 | 4 | 2026-07-04 |
| 18 | Kimi K2.5 | Moonshot | 87.1 | 2 | 2026-08-23 |
| 19 | GPT-5.1 | OpenAI | 87 | 1 | 2026-05-18 |
| 20 | ERNIE 5.0 Thinking Preview | Baidu | 87 | 1 | 2026-08-23 |
| 21 | GPT-5.2 | OpenAI | 87 | 2 | 2026-06-15 |
| 22 | Nemotron 3 Ultra 550B A55B | NVIDIA | 86.8 | 1 | 2026-06-06 |
| 23 | nvidia-nemotron-3-ultra-550b-a55b | NVIDIA | 86.8 | 1 | 2026-08-24 |
| 24 | Qwen3.5 122B A10B | Alibaba | 86.7 | 1 | 2026-08-23 |
| 25 | Claude 4 Opus | Anthropic | 86.6 | 4 | 2026-06-15 |
| 26 | DeepSeek-V4-Flash | DeepSeek | 86.4 | 7 | 2026-07-04 |
| 27 | Solar Pro4 | Upstage | 86.3 | 1 | 2026-08-23 |
| 28 | Qwen3.6 27B | Alibaba | 86.2 | 2 | 2026-08-23 |
| 29 | Qwen3.5 27B | Alibaba | 86.1 | 3 | 2026-08-23 |
| 30 | DeepSeek-V3.2 | DeepSeek | 86 | 8 | 2026-08-23 |
| 31 | Gemini 2.5 Pro Preview 06.05 (32k think) | 86 | 2 | 2026-06-05 | |
| 32 | GLM-5.1 | Z.ai | 86 | 3 | 2026-06-27 |
| 33 | Gemini 2.5 Pro | 86 | 1 | 2026-06-06 | |
| 34 | GLM-5.1-744B-A40B | Z.ai | 85.9 | 1 | 2026-06-06 |
| 35 | Qwen3.6 35B A3B | Alibaba | 85.6 | 4 | 2026-08-23 |
| 36 | Qwen3.5 35B A3B | Alibaba | 85.3 | 3 | 2026-08-23 |
| 37 | Gemma 4 31B | 85.2 | 29 | 2026-08-23 | |
| 38 | Gemma 4 26B A4B | 85.2 | 31 | 2026-08-23 | |
| 39 | o3 | OpenAI | 85 | 2 | 2026-06-05 |
| 40 | DeepSeek-R1 | DeepSeek | 85 | 17 | 2026-08-23 |
| 41 | MAI-Thinking-1 | Microsoft | 85 | 1 | 2026-08-23 |
| 42 | DeepSeek-V3.2-Exp | DeepSeek | 85 | 1 | 2026-08-23 |
| 43 | MiMo V2 Flash | Xiaomi | 84.9 | 3 | 2026-08-23 |
| 44 | DeepSeek-V3.1 | DeepSeek | 84.8 | 3 | 2026-08-23 |
| 45 | Kimi K2 (Reasoning) | Moonshot | 84.6 | 6 | 2026-06-13 |
| 46 | GLM-4.5 | Z.ai | 84.6 | 1 | 2026-08-23 |
| 47 | Step 3.5 Flash | StepFun | 84.4 | 1 | 2026-05-03 |
| 48 | GLM-4.7 | Z.ai | 84.3 | 2 | 2026-08-23 |
| 49 | Claude Sonnet 4 | Anthropic | 84 | 3 | 2026-06-15 |
| 50 | Nemotron 3 Super | NVIDIA | 83.9 | 1 | 2026-08-11 |
| 51 | Nemotron 3 Super 120B A12B | NVIDIA | 83.8 | 3 | 2026-08-23 |
| 52 | Qwen3 VL 235B A22B Reasoning | Alibaba | 83.8 | 1 | 2026-08-23 |
| 53 | GLM-4.6 | Z.ai | 83.2 | 2 | 2026-06-06 |
| 54 | Qwen3 235B A22B Instruct 2507 | Alibaba | 83 | 1 | 2026-08-23 |
| 55 | Qwen3 235B A22B | Alibaba | 83 | 5 | 2026-08-23 |
| 56 | Seed Oss 36B Instruct | ByteDance | 82.7 | 1 | 2026-06-15 |
| 57 | Qwen3 Next 80B A3B | Alibaba | 82.7 | 1 | 2026-08-23 |
| 58 | Kimi K2 (Non-Reasoning) | Moonshot | 82.5 | 1 | 2026-08-23 |
| 59 | Qwen3.5 9B | Alibaba | 82.5 | 1 | 2026-08-23 |
| 60 | NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | NVIDIA | 82.4 | 1 | 2026-07-07 |
| 61 | Qwen3 VL 32B Reasoning | Alibaba | 82.1 | 1 | 2026-08-23 |
| 62 | MiniMax M2 | MiniMax | 82 | 3 | 2026-08-23 |
| 63 | Nemotron 3.5 Lightning | NVIDIA | 81.9 | 2 | 2026-08-11 |
| 64 | Qwen3 30B A3B | Alibaba | 81.9 | 1 | 2026-06-15 |
| 65 | MiniMax 2.7 230B A10B | MiniMax | 81.9 | 1 | 2026-06-06 |
| 66 | Qwen3 VL 235B A22B Instruct | Alibaba | 81.8 | 1 | 2026-08-23 |
| 67 | Qwen3 32B | Alibaba | 81.8 | 1 | 2026-06-15 |
| 68 | Sarvam 105B | Sarvam AI | 81.7 | 1 | 2026-08-23 |
| 69 | GLM-4.5-Air | Z.ai | 81.4 | 1 | 2026-08-23 |
| 70 | DeepSeek-V3 | DeepSeek | 81.2 | 14 | 2026-08-23 |
| 71 | MiniMax M1 80K | MiniMax | 81.1 | 3 | 2026-08-23 |
| 72 | Kimi K2 Instruct | Moonshot | 81.1 | 4 | 2026-08-23 |
| 73 | Qwen3 Next 80B A3B Instruct | Alibaba | 80.6 | 1 | 2026-08-23 |
| 74 | MiniMax M1 40K | MiniMax | 80.6 | 3 | 2026-08-23 |
| 75 | Llama 4 Maverick | Meta | 80.5 | 3 | 2026-08-23 |
| 76 | Qwen3 VL 30B A3B Reasoning | Alibaba | 80.5 | 1 | 2026-08-23 |
| 77 | OpenAI o1-mini | OpenAI | 80.3 | 10 | 2026-07-03 |
| 78 | Sarvam 30B | Sarvam AI | 80 | 1 | 2026-08-23 |
| 79 | Grok 3 Beta | SpaceXAI | 79.9 | 1 | 2026-07-13 |
| 80 | Qwen3.5 4B | Alibaba | 79.1 | 1 | 2026-08-23 |
| 81 | Nemotron 3 Ultra 550B A55B Base | NVIDIA | 79.1 | 1 | 2026-06-05 |
| 82 | NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | NVIDIA | 79.1 | 1 | 2026-08-24 |
| 83 | Grok 3 Mini Beta | SpaceXAI | 78.9 | 1 | 2026-07-13 |
| 84 | Qwen3 VL 32B Instruct | Alibaba | 78.6 | 1 | 2026-08-23 |
| 85 | Nemotron 3 Nano | NVIDIA | 78.5 | 1 | 2026-08-11 |
| 86 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 78.3 | 2 | 2026-08-23 |
| 87 | LongCat Flash Lite | Meituan | 78.3 | 1 | 2026-08-23 |
| 88 | Claude 3.5 Sonnet | Anthropic | 78 | 13 | 2026-08-23 |
| 89 | Mistral Small 4 | Mistral | 78 | 1 | 2026-08-23 |
| 90 | Qwen3 VL 30B A3B Instruct | Alibaba | 77.8 | 1 | 2026-08-23 |
| 91 | Qwen3 VL Thinking (8B) | Alibaba | 77.3 | 1 | 2026-08-23 |
| 92 | Gemma 4 12B | 77.2 | 27 | 2026-08-23 | |
| 93 | Gemini 2.0 Flash Exp | 76.4 | 1 | 2026-06-06 | |
| 94 | gpt-oss-20b | OpenAI | 76.4 | 1 | 2026-08-11 |
| 95 | Gemini 2.0 Flash (Reasoning) | 76.4 | 1 | 2026-08-23 | |
| 96 | Phi 4 Reasoning Plus | Microsoft | 76 | 1 | 2026-08-23 |
| 97 | Gemini 1.5 Pro | 75.8 | 2 | 2026-08-23 | |
| 98 | MiniMax Text 01 | MiniMax | 75.7 | 1 | 2026-06-06 |
| 99 | Grok 2 | SpaceXAI | 75.5 | 1 | 2026-08-23 |
| 100 | GPT-4o | OpenAI | 74.7 | 13 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.