MHPP (Mostly Hard Python Problems) — Distinct harder-difficulty companion to MBPP, not the same benchmark.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Seed Coder 8B Instruct | ByteDance | 36.2 | 1 | 2026-06-05 |
| 2 | Qwen3 8B | Alibaba | 32.8 | 1 | 2026-06-05 |
| 3 | Yi Coder 9B Chat | 01.AI | 26.7 | 1 | 2026-06-05 |
| 4 | DeepSeek-Coder-6.7B-Instruct | DeepSeek | 20 | 1 | 2026-06-05 |
| 5 | Llama 3.1 8B Instruct | Meta | 17.1 | 1 | 2026-06-05 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.