MBPP-Sanitized (curated subset) — Distinct curated/cleaned subset of MBPP, not the same as MBPP or MBPP+.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Nemotron 3 Ultra 550B A55B Base | NVIDIA | 86 | 1 | 2026-06-05 |
| 2 | NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 | NVIDIA | 86 | 1 | 2026-08-24 |
| 3 | Mistral Large 3 675B Base 2512 | Mistral | 84.1 | 1 | 2026-06-05 |
| 4 | GLM-4.5-Base | Z.ai | 76.7 | 1 | 2026-06-05 |
| 5 | Kimi K2 Base | Moonshot | 72.1 | 1 | 2026-06-05 |
| 6 | DeepSeek-V3.2-Exp-Base | DeepSeek | 58.7 | 1 | 2026-06-05 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.