SciCode — Scientific coding bench; folds aa_scicode/no-tools raws at problem level. Distinct from subtask.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Claude Fable 5 | Anthropic | 60.2 | 2 | 2026-07-27 |
| 2 | Gemini 3.1 Pro | 59 | 7 | 2026-08-24 | |
| 3 | Kimi K3 | Moonshot | 58.7 | 4 | 2026-07-31 |
| 4 | Muse Spark 1.1 | Meta | 58.2 | 1 | 2026-07-11 |
| 5 | Gemini 3.7 Flash | 57.9 | 3 | 2026-08-14 | |
| 6 | GPT-5.6 Sol | OpenAI | 56.9 | 7 | 2026-07-27 |
| 7 | GPT-5.4 | OpenAI | 56.6 | 4 | 2026-05-03 |
| 8 | GLM-5.3 | Z.ai | 56.5 | 1 | 2026-08-19 |
| 9 | Muse Spark 1.2 | Meta | 56.4 | 1 | 2026-08-06 |
| 10 | Gemini 3 Pro | 56.1 | 6 | 2026-08-24 | |
| 11 | GPT-5.5 | OpenAI | 56.1 | 6 | 2026-07-27 |
| 12 | Opus 5 | Anthropic | 55.7 | 5 | 2026-07-25 |
| 13 | GPT-5.2 Codex | OpenAI | 54.6 | 1 | 2026-05-02 |
| 14 | Grok 4.6 | SpaceXAI | 54.6 | 4 | 2026-08-22 |
| 15 | Claude Opus 4.7 | Anthropic | 54.5 | 2 | 2026-06-01 |
| 16 | Grok4.5 | SpaceXAI | 54.1 | 1 | 2026-07-09 |
| 17 | GPT-5.6 Terra | OpenAI | 53.9 | 6 | 2026-07-10 |
| 18 | Claude Sonnet 5 | Anthropic | 53.6 | 2 | 2026-07-02 |
| 19 | Qwen3.7 Max | Alibaba | 53.5 | 2 | 2026-08-23 |
| 20 | Claude Opus 4.8 | Anthropic | 53.5 | 2 | 2026-07-27 |
| 21 | Kimi K2.6 | Moonshot | 53.5 | 5 | 2026-08-23 |
| 22 | GPT-5.3 Codex | OpenAI | 53.2 | 1 | 2026-05-02 |
| 23 | Gemini 3.5 Flash | 53.1 | 4 | 2026-07-07 | |
| 24 | Qwen3.8 Max Preview | Alibaba | 52.9 | 1 | 2026-08-06 |
| 25 | Gemini 3.6 Flash | 52.7 | 1 | 2026-07-22 | |
| 26 | GPT-5.6 Luna | OpenAI | 52.5 | 8 | 2026-07-30 |
| 27 | GPT-5.2 | OpenAI | 52.1 | 7 | 2026-08-24 |
| 28 | Claude Opus 4.6 | Anthropic | 52 | 5 | 2026-08-24 |
| 29 | Qwen3.8 2.4T A95B | Alibaba | 51.6 | 1 | 2026-08-14 |
| 30 | Muse Spark | Meta | 51.5 | 2 | 2026-07-07 |
| 31 | Qwen3.7 Plus Preview | Alibaba | 51.3 | 3 | 2026-08-23 |
| 32 | Gemini 3 Flash Preview | 50.6 | 2 | 2026-05-02 | |
| 33 | GLM-5.2 Full Open Source | Z.ai | 50.5 | 3 | 2026-07-27 |
| 34 | GPT-5.5 Instant | OpenAI | 50.3 | 4 | 2026-07-07 |
| 35 | Grok Build 0.1 | SpaceXAI | 50.2 | 2 | 2026-07-07 |
| 36 | DeepSeek-V4-Pro | DeepSeek | 50 | 3 | 2026-06-29 |
| 37 | Claude Opus 4.5 | Anthropic | 50 | 5 | 2026-08-24 |
| 38 | DeepSeek-V4-Flash | DeepSeek | 49.9 | 7 | 2026-08-01 |
| 39 | GPT-5.4 mini | OpenAI | 49.9 | 3 | 2026-06-01 |
| 40 | Kimi K2.5 | Moonshot | 49 | 5 | 2026-08-23 |
| 41 | Inkling-Small | Thinking Machines | 48.7 | 4 | 2026-08-23 |
| 42 | Hy3-preview | Tencent | 47.6 | 2 | 2026-05-02 |
| 43 | Kimi K2.7 Code | Moonshot | 47.5 | 2 | 2026-07-07 |
| 44 | Grok 4.3 | SpaceXAI | 47.3 | 5 | 2026-05-23 |
| 45 | MiniMax M2.7 | MiniMax | 47 | 4 | 2026-07-30 |
| 46 | Claude Sonnet 4.6 | Anthropic | 47 | 4 | 2026-05-02 |
| 47 | GPT-5.4 nano | OpenAI | 46.9 | 3 | 2026-06-01 |
| 48 | Qwen3.6 Max Preview | Alibaba | 46.9 | 1 | 2026-05-02 |
| 49 | o4-mini | OpenAI | 46.5 | 1 | 2026-05-02 |
| 50 | GLM-5 | Z.ai | 46.2 | 2 | 2026-05-02 |
| 51 | Inkling | Thinking Machines | 46.1 | 2 | 2026-07-30 |
| 52 | Grok 4 | SpaceXAI | 45.7 | 2 | 2026-07-07 |
| 53 | Grok 4.20 0309 V2 | SpaceXAI | 45.6 | 3 | 2026-06-18 |
| 54 | Solar Open2 250B | Upstage | 45.6 | 1 | 2026-08-13 |
| 55 | MiniMax M3 | MiniMax | 45.4 | 2 | 2026-07-07 |
| 56 | GLM-4.7 | Z.ai | 45.1 | 2 | 2026-06-01 |
| 57 | Claude Sonnet 4.5 | Anthropic | 45 | 7 | 2026-08-24 |
| 58 | Kimi K2 (Reasoning) | Moonshot | 44.8 | 5 | 2026-07-07 |
| 59 | Grok 4.20 | SpaceXAI | 44.7 | 1 | 2026-05-02 |
| 60 | Qwen3.8 27B | Alibaba | 44.7 | 4 | 2026-08-22 |
| 61 | MiniMax M2.5 | MiniMax | 44.4 | 3 | 2026-08-24 |
| 62 | Motif-3-Beta | Motif Technologies | 44.3 | 1 | 2026-07-21 |
| 63 | Grok 4.1 Fast | SpaceXAI | 44.2 | 2 | 2026-06-23 |
| 64 | Grok 4 Fast | SpaceXAI | 44.2 | 2 | 2026-05-02 |
| 65 | DeepSeek-V3.2-Speciale | DeepSeek | 44 | 2 | 2026-07-07 |
| 66 | GLM-5.1 | Z.ai | 43.8 | 2 | 2026-05-02 |
| 67 | GLM-5-Turbo | Z.ai | 43.6 | 2 | 2026-07-07 |
| 68 | Solar Pro4 | Upstage | 43.6 | 1 | 2026-08-13 |
| 69 | Muse Glimmer | Meta | 43.6 | 1 | 2026-08-11 |
| 70 | muse-glimmer-30b | Meta | 43.6 | 1 | 2026-08-23 |
| 71 | GLM 5V Turbo | Z.ai | 43.5 | 1 | 2026-06-01 |
| 72 | Gemma 4 31B | 43.4 | 2 | 2026-06-01 | |
| 73 | Claude Haiku 4.5 | Anthropic | 43.3 | 2 | 2026-06-01 |
| 74 | GPT-5.1 | OpenAI | 43.3 | 2 | 2026-06-20 |
| 75 | MiMo V2.5 Pro | Xiaomi | 43.1 | 5 | 2026-07-30 |
| 76 | Gemini 2.5 Pro | 43 | 7 | 2026-07-07 | |
| 77 | GPT-5 | OpenAI | 43 | 8 | 2026-07-07 |
| 78 | Nova 2.0 Pro Preview | Amazon | 42.7 | 3 | 2026-05-02 |
| 79 | GPT-5.1 Codex mini | OpenAI | 42.6 | 1 | 2026-05-02 |
| 80 | MiMo V2 Pro | Xiaomi | 42.5 | 2 | 2026-07-07 |
| 81 | Qwen3 235B A22B | Alibaba | 42.4 | 3 | 2026-06-18 |
| 82 | Agnes 2.5 Pro Alpha | Sapiens AI | 42.2 | 1 | 2026-07-25 |
| 83 | Nemotron 3 Super 120B A12B | NVIDIA | 42 | 2 | 2026-08-23 |
| 84 | Qwen3.5 122B A10B | Alibaba | 42 | 2 | 2026-05-02 |
| 85 | Qwen3.5 397B A17B | Alibaba | 42 | 4 | 2026-07-30 |
| 86 | Gemini 3.1 Flash Lite Preview | 41.9 | 2 | 2026-07-07 | |
| 87 | Nex-N2-Pro | Nex AGI | 41.8 | 2 | 2026-07-07 |
| 88 | GLM-4.5 | Z.ai | 41.7 | 2 | 2026-08-23 |
| 89 | Ling-3.0-flash | InclusionAI | 41.1 | 1 | 2026-08-06 |
| 90 | MiniMax M2.1 | MiniMax | 41 | 5 | 2026-08-24 |
| 91 | GPT-5 mini | OpenAI | 41 | 5 | 2026-07-07 |
| 92 | o3 | OpenAI | 41 | 2 | 2026-07-07 |
| 93 | K-EXAONE 2.0 0803 | LG AI | 41 | 1 | 2026-08-13 |
| 94 | Gemini 3.5 Flash Lite | 40.9 | 3 | 2026-07-30 | |
| 95 | Claude Opus 4.1 | Anthropic | 40.9 | 1 | 2026-06-01 |
| 96 | GPT-5 Codex | OpenAI | 40.9 | 1 | 2026-05-02 |
| 97 | Claude 4 Opus | Anthropic | 40.9 | 2 | 2026-06-01 |
| 98 | Qwen3.6 Plus | Alibaba | 40.7 | 2 | 2026-07-07 |
| 99 | Doubao Seed Code | ByteDance | 40.7 | 2 | 2026-07-07 |
| 100 | Grok 3 Mini Reasoning | SpaceXAI | 40.6 | 1 | 2026-06-01 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.