HumanEval+ (EvalPlus rigorous test-case extension) — Well-known stricter-test-suite extension of HumanEval, distinct benchmark from base HumanEval.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Phi 4 Reasoning Plus | Microsoft | 92.3 | 1 | 2026-08-23 |
| 2 | Granite 3.3 8B Instruct | IBM | 86.1 | 2 | 2026-08-23 |
| 3 | Granite 3.1 8B Instruct | IBM | 85.8 | 1 | 2026-06-11 |
| 4 | Granite 3.2 8B Instruct | IBM | 85.7 | 1 | 2026-06-11 |
| 5 | Granite 4.1 30B | IBM | 85.4 | 1 | 2026-06-15 |
| 6 | Kimi K2 Base | Moonshot | 84.8 | 5 | 2026-06-13 |
| 7 | Phi 4 | Microsoft | 82.8 | 1 | 2026-08-23 |
| 8 | Seed Coder 8B Instruct | ByteDance | 82.3 | 1 | 2026-06-05 |
| 9 | Llama 3.1 8B Instruct | Meta | 80.2 | 1 | 2026-06-11 |
| 10 | Granite 4.1 8B | IBM | 79.9 | 1 | 2026-06-15 |
| 11 | DeepSeek-R1-Distill-Qwen-7B | DeepSeek | 78.4 | 1 | 2026-06-11 |
| 12 | Granite 3.3 2B Instruct | IBM | 75.7 | 1 | 2026-06-11 |
| 13 | MiMo V2.5 Pro Base | Xiaomi | 75.6 | 3 | 2026-06-05 |
| 14 | MiMo V2.5 Pro | Xiaomi | 75.6 | 1 | 2026-08-23 |
| 15 | Granite 3.1 2B Instruct | IBM | 75.3 | 1 | 2026-06-11 |
| 16 | Granite 3.2 2B Instruct | IBM | 73.4 | 1 | 2026-06-11 |
| 17 | Step3.5 Flash Base | StepFun | 72 | 2 | 2026-06-05 |
| 18 | MiMo V2.5 Base | Xiaomi | 71.3 | 3 | 2026-06-05 |
| 19 | MiMo V2 Flash Base | Xiaomi | 70.7 | 4 | 2026-06-13 |
| 20 | DeepSeek-V3.2-Exp-Base | DeepSeek | 67.7 | 4 | 2026-06-13 |
| 21 | Qwen3.5 2B | Alibaba | 66 | 1 | 2026-08-15 |
| 22 | DeepSeek-V3.1-Base | DeepSeek | 64.6 | 4 | 2026-06-13 |
| 23 | DeepSeek-R1-Distill-Llama-8B | DeepSeek | 62.9 | 1 | 2026-06-11 |
| 24 | Granite 4.1 8B Base | IBM | 62.8 | 2 | 2026-06-15 |
| 25 | Granite 4.1 30B Base | IBM | 62.2 | 2 | 2026-06-15 |
| 26 | Granite 4.1 3B Base | IBM | 54.3 | 1 | 2026-06-15 |
| 27 | Qwen3.5 0.8B | Alibaba | 46.8 | 1 | 2026-08-15 |
| 28 | ERNIE 4.5 | Baidu | 25 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.