HumanEval (code generation, pass@1) — Standard HumanEval; max=6252 is a clear data anomaly (impossible), flagged for QA not naming.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Kimi K2 (Non-Reasoning) | Moonshot | 94.5 | 1 | 2026-08-23 |
| 2 | Claude 3.5 Sonnet | Anthropic | 93.7 | 2 | 2026-08-23 |
| 3 | GPT-5 | OpenAI | 93.4 | 1 | 2026-08-23 |
| 4 | Kimi K2 Instruct | Moonshot | 93.3 | 1 | 2026-08-23 |
| 5 | Qwen 2.5 Coder 32B Instruct | Alibaba | 92.7 | 1 | 2026-08-23 |
| 6 | OpenAI o1-mini | OpenAI | 92.4 | 1 | 2026-08-23 |
| 7 | DeepSeek-V3 | DeepSeek | 92.1 | 2 | 2026-06-06 |
| 8 | Sarvam 30B | Sarvam AI | 92.1 | 1 | 2026-08-23 |
| 9 | Mistral Large 2 | Mistral | 92 | 1 | 2026-08-23 |
| 10 | Qwen2.5 VL 32B | Alibaba | 91.5 | 1 | 2026-08-23 |
| 11 | GPT-4o | OpenAI | 90.6 | 3 | 2026-08-23 |
| 12 | Hunyuan Large Inst. | Tencent | 90 | 1 | 2026-05-31 |
| 13 | Granite 3.3 8B Instruct | IBM | 89.7 | 2 | 2026-08-23 |
| 14 | Granite 3.1 8B Instruct | IBM | 89.6 | 1 | 2026-06-11 |
| 15 | Gemini 2.0 Flash Exp | 89.6 | 1 | 2026-06-06 | |
| 16 | Granite 3.2 8B Instruct | IBM | 89.3 | 1 | 2026-06-11 |
| 17 | Nova Pro (Non-Reasoning) | Amazon | 89 | 1 | 2026-08-23 |
| 18 | DeepSeek-V2.5 | DeepSeek | 89 | 2 | 2026-08-23 |
| 19 | Llama 3.1 Instruct 405B | Meta | 89 | 6 | 2026-08-23 |
| 20 | Granite 4.1 30B | IBM | 88.4 | 1 | 2026-06-15 |
| 21 | Grok 2 | SpaceXAI | 88.4 | 1 | 2026-08-23 |
| 22 | Llama 3.3 70B Instruct | Meta | 88.4 | 3 | 2026-08-23 |
| 23 | o1 | OpenAI | 88.1 | 1 | 2026-08-23 |
| 24 | Claude 3.5 Haiku | Anthropic | 88.1 | 1 | 2026-08-23 |
| 25 | GPT-4.5 Preview | OpenAI | 88 | 1 | 2026-08-23 |
| 26 | Gemma 3 27B | 87.8 | 1 | 2026-08-23 | |
| 27 | GPT-4o mini | OpenAI | 87.2 | 2 | 2026-08-23 |
| 28 | GPT-4 Turbo | OpenAI | 87.1 | 1 | 2026-08-23 |
| 29 | MiniMax Text 01 | MiniMax | 86.9 | 1 | 2026-06-06 |
| 30 | Qwen2.5 Instruct 72B | Alibaba | 86.6 | 4 | 2026-08-23 |
| 31 | Gemini 1.5 Pro | 86.6 | 2 | 2026-08-23 | |
| 32 | Qwen2 Instruct (72B) | Alibaba | 86 | 1 | 2026-08-23 |
| 33 | Grok 2 Mini | SpaceXAI | 85.7 | 1 | 2026-08-23 |
| 34 | Nova Lite (Non-Reasoning) | Amazon | 85.4 | 1 | 2026-08-23 |
| 35 | Gemma 3 12B | 85.4 | 1 | 2026-08-23 | |
| 36 | Granite 4.1 8B | IBM | 85.4 | 1 | 2026-06-15 |
| 37 | Llama 3.1 8B Instruct | Meta | 85.3 | 4 | 2026-08-23 |
| 38 | Claude 3 Opus | Anthropic | 84.9 | 1 | 2026-08-23 |
| 39 | Qwen3 8B | Alibaba | 84.8 | 1 | 2026-06-05 |
| 40 | Kimi K2 Base | Moonshot | 84.8 | 3 | 2026-06-05 |
| 41 | MAI-Thinking-1 | Microsoft | 84.2 | 1 | 2026-08-14 |
| 42 | NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | NVIDIA | 83.8 | 1 | 2026-08-24 |
| 43 | Nemotron 3 Ultra 550B A55B Base | NVIDIA | 83.8 | 1 | 2026-06-05 |
| 44 | Seed Coder 8B Instruct | ByteDance | 82.9 | 1 | 2026-06-05 |
| 45 | Phi 4 | Microsoft | 82.6 | 2 | 2026-08-23 |
| 46 | Yi Coder 9B Chat | 01.AI | 82.3 | 1 | 2026-06-05 |
| 47 | Step3.5 Flash Base | StepFun | 81.1 | 2 | 2026-06-05 |
| 48 | Nova Micro (Non-Reasoning) | Amazon | 81.1 | 1 | 2026-08-23 |
| 49 | Granite 3.3 2B Instruct | IBM | 80.5 | 1 | 2026-06-11 |
| 50 | Llama 3.1 70B Instruct | Meta | 80.5 | 3 | 2026-08-23 |
| 51 | Nemotron 3 Super 120B A12B | NVIDIA | 80.5 | 1 | 2026-08-11 |
| 52 | Granite 3.2 2B Instruct | IBM | 80.1 | 1 | 2026-06-11 |
| 53 | Qwen2 7B Instruct | Alibaba | 79.9 | 1 | 2026-08-23 |
| 54 | DeepSeek-R1-Distill-Qwen-7B | DeepSeek | 79.9 | 1 | 2026-06-11 |
| 55 | GLM-4.5-Base | Z.ai | 79.8 | 3 | 2026-06-05 |
| 56 | Granite 3.1 2B Instruct | IBM | 79.5 | 1 | 2026-06-11 |
| 57 | Stable-DiffCoder-8B-Base | ByteDance | 79.3 | 1 | 2026-06-05 |
| 58 | Qwen2.5 Omni 7B | Alibaba | 78.7 | 1 | 2026-08-23 |
| 59 | Qwen3.6 27B | Alibaba | 78.2 | 1 | 2026-05-01 |
| 60 | Nemotron 3.5 Lightning | NVIDIA | 77.4 | 1 | 2026-08-11 |
| 61 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 | NVIDIA | 77.4 | 1 | 2026-08-24 |
| 62 | MiMo V2 Flash Base | Xiaomi | 77.4 | 2 | 2026-06-05 |
| 63 | DeepSeek-V4-Pro-Base | DeepSeek | 76.8 | 4 | 2026-06-27 |
| 64 | Granite 4.1 3B Base | IBM | 76.2 | 1 | 2026-06-15 |
| 65 | Claude 3 Haiku | Anthropic | 75.9 | 1 | 2026-08-23 |
| 66 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 75 | 1 | 2026-08-11 |
| 67 | DeepSeek-Coder-6.7B-Instruct | DeepSeek | 74.4 | 1 | 2026-06-05 |
| 68 | Claude 3 Sonnet | Anthropic | 73 | 1 | 2026-08-23 |
| 69 | DeepSeek-V3.1-Base | DeepSeek | 72.5 | 2 | 2026-06-05 |
| 70 | Qwen 2.5 14B | Alibaba | 72.1 | 1 | 2026-05-30 |
| 71 | Qwen2.5 Coder Instruct 7B | Alibaba | 72 | 1 | 2026-06-05 |
| 72 | Hunyuan Large | Tencent | 71.4 | 1 | 2026-05-31 |
| 73 | Gemma 3 4B | 71.3 | 1 | 2026-08-23 | |
| 74 | Claude 2 | Anthropic | 71.2 | 2 | 2026-08-12 |
| 75 | Phi 3.5 MoE Instruct | Microsoft | 70.7 | 1 | 2026-08-23 |
| 76 | DeepSeek-V4-Flash-Base | DeepSeek | 69.5 | 4 | 2026-06-27 |
| 77 | Granite 4.1 8B Base | IBM | 68.3 | 2 | 2026-06-15 |
| 78 | Phi 3 Medium 4K Instruct | Microsoft | 67.8 | 1 | 2026-05-30 |
| 79 | DeepSeek-V3.2-Exp-Base | DeepSeek | 67.7 | 3 | 2026-06-05 |
| 80 | Granite 4.1 30B Base | IBM | 67.7 | 2 | 2026-06-15 |
| 81 | DeepSeek-R1-Distill-Llama-8B | DeepSeek | 67.5 | 1 | 2026-06-11 |
| 82 | GPT4 | OpenAI | 67 | 2 | 2026-08-23 |
| 83 | Mistral Large 3 675B Base 2512 | Mistral | 66.7 | 1 | 2026-06-05 |
| 84 | Qwen3.5 35B A3B | Alibaba | 66.5 | 1 | 2026-08-11 |
| 85 | Grok | SpaceXAI | 63.2 | 1 | 2026-08-12 |
| 86 | Phi 3.5 Mini Instruct | Microsoft | 62.8 | 1 | 2026-08-23 |
| 87 | DeepSeek-V3.2-Base | DeepSeek | 62.8 | 4 | 2026-06-27 |
| 88 | Gemma 2 27B IT | 51.8 | 1 | 2026-08-23 | |
| 89 | Gemma 4 26B A4B | 50 | 1 | 2026-08-11 | |
| 90 | DeepSeek-V2 | DeepSeek | 48.8 | 2 | 2026-05-31 |
| 91 | Moonlight | Moonshot | 48.1 | 2 | 2026-06-12 |
| 92 | DeepSeek-Coder-6.7B-Base | DeepSeek | 47.6 | 1 | 2026-06-05 |
| 93 | Qwen2.5 3B | Alibaba | 42.1 | 2 | 2026-06-05 |
| 94 | Gemma 3 1B | 41.5 | 1 | 2026-08-23 | |
| 95 | Gemma 2 Instruct (9B) | 40.2 | 1 | 2026-08-23 | |
| 96 | Inflection-1 | SpaceXAI | 35.4 | 1 | 2026-08-12 |
| 97 | Llama 3.2 3B Instruct | Meta | 28 | 2 | 2026-06-05 |
| 98 | LFM2.5-8B-A1B-DSpark | Liquid AI | 7 | 2 | 2026-08-21 |
| 99 | LFM2.5-2.6B-DSpark | Liquid AI | 4.5 | 2 | 2026-08-21 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.