MMLU — Base MMLU (169 models); per anchor MMLU != Pro != Redux != ProX -- never merge across family.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Claude 4 Opus | Anthropic | 92.9 | 2 | 2026-06-15 |
| 2 | DeepSeek-R1 | DeepSeek | 92.9 | 6 | 2026-06-04 |
| 3 | Gemini 3.1 Pro | 92.6 | 1 | 2026-08-24 | |
| 4 | o1 | OpenAI | 91.8 | 5 | 2026-06-04 |
| 5 | Claude Sonnet 4 | Anthropic | 91.5 | 2 | 2026-06-15 |
| 6 | DeepSeek-V4-Pro-Base | DeepSeek | 90.1 | 7 | 2026-06-27 |
| 7 | Hunyuan Large Inst. | Tencent | 89.9 | 1 | 2026-05-31 |
| 8 | Kimi K2 Instruct | Moonshot | 89.5 | 2 | 2026-06-15 |
| 9 | MiMo V2.5 Pro Base | Xiaomi | 89.4 | 3 | 2026-06-05 |
| 10 | DeepSeek-V3 | DeepSeek | 89.4 | 11 | 2026-06-15 |
| 11 | Nemotron 3 Ultra 550B A55B Base | NVIDIA | 89.1 | 1 | 2026-06-05 |
| 12 | NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | NVIDIA | 89.1 | 1 | 2026-08-24 |
| 13 | R1-Zero | DeepSeek | 88.8 | 1 | 2026-05-03 |
| 14 | DeepSeek-V4-Flash-Base | DeepSeek | 88.7 | 7 | 2026-06-27 |
| 15 | Llama 3.1 Instruct 405B | Meta | 88.6 | 7 | 2026-06-06 |
| 16 | MiniMax Text 01 | MiniMax | 88.5 | 1 | 2026-06-06 |
| 17 | Hunyuan Large | Tencent | 88.4 | 1 | 2026-05-31 |
| 18 | Claude 3.5 Sonnet | Anthropic | 88.3 | 8 | 2026-06-06 |
| 19 | Kimi K2 Base | Moonshot | 88.2 | 10 | 2026-06-13 |
| 20 | GPT-4o | OpenAI | 88.1 | 10 | 2026-06-06 |
| 21 | DeepSeek-V3.2-Exp-Base | DeepSeek | 87.8 | 5 | 2026-06-13 |
| 22 | DeepSeek-V3.2-Base | DeepSeek | 87.8 | 4 | 2026-06-27 |
| 23 | GLM-4.5-Base | Z.ai | 87.7 | 5 | 2026-06-05 |
| 24 | DeepSeek-V3-Base | DeepSeek | 87.7 | 2 | 2026-06-05 |
| 25 | MAI-Thinking-1 | Microsoft | 87.6 | 1 | 2026-08-14 |
| 26 | Hy3 preview-Base | Tencent | 87.4 | 2 | 2026-06-05 |
| 27 | DeepSeek-V3.1-Base | DeepSeek | 87.4 | 4 | 2026-06-13 |
| 28 | Seed Oss 36B Instruct | ByteDance | 87.4 | 1 | 2026-06-15 |
| 29 | Mistral Large 3 675B Base 2512 | Mistral | 87.3 | 1 | 2026-06-05 |
| 30 | Qwen3 235B A22B | Alibaba | 87 | 2 | 2026-06-15 |
| 31 | Qwen3 30B A3B | Alibaba | 86.9 | 1 | 2026-06-15 |
| 32 | Gemini 1.5 Pro | 86.8 | 3 | 2026-06-06 | |
| 33 | OpenAI o1-mini | OpenAI | 86.7 | 5 | 2026-06-04 |
| 34 | MiMo V2 Flash Base | Xiaomi | 86.7 | 4 | 2026-06-13 |
| 35 | Gemini 2.0 Flash Exp | 86.5 | 2 | 2026-06-06 | |
| 36 | GPT4 | OpenAI | 86.4 | 3 | 2026-08-12 |
| 37 | Llama 3.3 70B Instruct | Meta | 86.3 | 2 | 2026-05-30 |
| 38 | MiMo V2.5 Base | Xiaomi | 86.3 | 3 | 2026-06-05 |
| 39 | Qwen3 32B | Alibaba | 86.2 | 1 | 2026-06-15 |
| 40 | Qwen2.5 Instruct 72B | Alibaba | 86.1 | 5 | 2026-06-06 |
| 41 | Nemotron 3 Super 120B A12B | NVIDIA | 86 | 1 | 2026-08-11 |
| 42 | Llama 3.1 70B Instruct | Meta | 86 | 2 | 2026-05-31 |
| 43 | Step3.5 Flash Base | StepFun | 85.8 | 2 | 2026-06-05 |
| 44 | Phi 4 | Microsoft | 84.8 | 1 | 2026-05-30 |
| 45 | Kimi VL A3B Thinking | Moonshot | 82 | 1 | 2026-06-05 |
| 46 | GPT-4o mini | OpenAI | 81.8 | 2 | 2026-05-30 |
| 47 | Qwen3.5 35B A3B | Alibaba | 81.1 | 1 | 2026-08-11 |
| 48 | DeepSeek-V2.5 | DeepSeek | 80.4 | 1 | 2026-05-31 |
| 49 | Qwen3 14B Base | Alibaba | 80.4 | 4 | 2026-06-05 |
| 50 | Granite 4.1 30B | IBM | 80.2 | 1 | 2026-06-15 |
| 51 | Qwen 2.5 14B | Alibaba | 79.9 | 1 | 2026-05-30 |
| 52 | Ministral 3 14B | Mistral | 79.4 | 4 | 2026-06-12 |
| 53 | Nemotron 3.5 Lightning | NVIDIA | 78.6 | 1 | 2026-08-11 |
| 54 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 | NVIDIA | 78.6 | 1 | 2026-08-24 |
| 55 | DeepSeek-V2 | DeepSeek | 78.5 | 2 | 2026-05-31 |
| 56 | Claude 2 | Anthropic | 78.5 | 2 | 2026-08-12 |
| 57 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 78.5 | 1 | 2026-08-11 |
| 58 | Granite 4.1 30B Base | IBM | 78.4 | 2 | 2026-06-15 |
| 59 | Qwen2.5 VL 32B | Alibaba | 78.4 | 1 | 2026-06-05 |
| 60 | Phi 3 Medium 4K Instruct | Microsoft | 77.9 | 2 | 2026-05-30 |
| 61 | Gemma 4 26B A4B | 77.8 | 1 | 2026-08-11 | |
| 62 | Claude 1.3 | Anthropic | 77 | 1 | 2026-07-17 |
| 63 | Qwen2 Instruct (72B) | Alibaba | 76.9 | 1 | 2026-05-10 |
| 64 | Gemma 3 27B | 76.9 | 2 | 2026-06-15 | |
| 65 | Claude 3 Opus | Anthropic | 76.8 | 1 | 2026-05-10 |
| 66 | Ministral 3 8B | Mistral | 76.1 | 3 | 2026-06-05 |
| 67 | Qwen3 8B Base | Alibaba | 76 | 4 | 2026-06-05 |
| 68 | Nova Pro (Non-Reasoning) | Amazon | 75.8 | 2 | 2026-06-19 |
| 69 | Qwen2.5 7B Base | Alibaba | 74.2 | 1 | 2026-05-03 |
| 70 | Palmyra-X-004 | Writer | 73.9 | 1 | 2026-05-10 |
| 71 | Granite 4.1 8B | IBM | 73.8 | 1 | 2026-06-15 |
| 72 | Granite 4.1 8B Base | IBM | 73.6 | 2 | 2026-06-15 |
| 73 | Grok | SpaceXAI | 73 | 1 | 2026-08-12 |
| 74 | Llama 3.1 8B Instruct | Meta | 73 | 2 | 2026-06-11 |
| 75 | Inflection-1 | SpaceXAI | 72.7 | 1 | 2026-08-12 |
| 76 | Mistral Large 2 | Mistral | 72.5 | 1 | 2026-05-10 |
| 77 | Gemini 2.0 Flash (experimental) | 71.7 | 1 | 2026-06-24 | |
| 78 | Qwen3 4B Base | Alibaba | 71.3 | 4 | 2026-06-05 |
| 79 | Yi Large (Preview) | 01.AI | 71.2 | 1 | 2026-05-10 |
| 80 | GPT-4 Turbo | OpenAI | 71.1 | 2 | 2026-06-18 |
| 81 | Llama 3.1 Instruct Turbo (70B) | Meta | 70.9 | 1 | 2026-05-10 |
| 82 | Ministral 3 3B | Mistral | 70.7 | 3 | 2026-06-05 |
| 83 | Gemini 1.5 Flash (001) | 70.3 | 2 | 2026-05-10 | |
| 84 | Llama 3.2 Vision Instruct Turbo (90B) | Meta | 70.3 | 1 | 2026-05-10 |
| 85 | Palmyra X V3 (72B) | Writer | 70.2 | 1 | 2026-05-10 |
| 86 | Moonlight | Moonshot | 70 | 2 | 2026-06-12 |
| 87 | Llama 3.3 Instruct Turbo (70B) | Meta | 70 | 1 | 2026-05-10 |
| 88 | Llama 3 (70B) | Meta | 69.5 | 1 | 2026-05-10 |
| 89 | Amazon Nova Lite | Amazon | 69.3 | 1 | 2026-06-23 |
| 90 | Jamba 1.5 Large | AI21 | 68.3 | 1 | 2026-05-10 |
| 91 | Solar Pro | Upstage | 67.9 | 1 | 2026-05-10 |
| 92 | Claude 3.5 Haiku | Anthropic | 67.1 | 2 | 2026-06-19 |
| 93 | Granite 3.2 8B Instruct | IBM | 66.8 | 1 | 2026-06-11 |
| 94 | Granite 3.1 8B Instruct | IBM | 66.8 | 1 | 2026-06-11 |
| 95 | Granite 4.1 3B Base | IBM | 66.5 | 1 | 2026-06-15 |
| 96 | Gemma 2 Instruct (27B) | 66.4 | 1 | 2026-05-10 | |
| 97 | Claude 3 Haiku | Anthropic | 66.2 | 1 | 2026-05-10 |
| 98 | Phi 3 Small 8K Instruct | Microsoft | 65.9 | 1 | 2026-05-10 |
| 99 | Qwen2.5 Instruct Turbo (7B) | Alibaba | 65.8 | 1 | 2026-05-10 |
| 100 | Qwen2.5 3B | Alibaba | 65.6 | 2 | 2026-06-05 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.