SciCode — Sub-task scoring granularity of SciCode, distinct from problem-level metric (median 48 vs 34.3).
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Kimi K2.6 1T A32B | Moonshot | 52 | 1 | 2026-06-06 |
| 2 | Qwen 3.5 397B 17B | Alibaba | 48 | 1 | 2026-06-06 |
| 3 | GLM-5.1-744B-A40B | Z.ai | 47.7 | 1 | 2026-06-06 |
| 4 | nvidia-nemotron-3-ultra-550b-a55b | NVIDIA | 44.6 | 1 | 2026-08-24 |
| 5 | Nemotron 3 Ultra 550B A55B | NVIDIA | 44.6 | 1 | 2026-06-06 |
| 6 | Nemotron 3 Super 120B A12B | NVIDIA | 42.3 | 1 | 2026-07-07 |
| 7 | NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 | NVIDIA | 40.6 | 1 | 2026-07-07 |
| 8 | MiniMax 2.7 230B A10B | MiniMax | 38.3 | 1 | 2026-06-06 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.