GPQA as measured by the HF Open LLM Leaderboard v2 (diamond+extended+main blend — NOT comparable to GPQA Diamond). Values are RAW accuracy, recovered from the leaderboard's published normalization (raw = norm×0.75+25; baseline 25%, verified). Unpooled.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Yi 1.5 9B | 01.AI | 37.9 | 1 | 2026-07-04 |
| 2 | Yi 1.5 34B | 01.AI | 36.6 | 1 | 2026-07-04 |
| 3 | Yi 1.5 34B Chat | 01.AI | 36.5 | 1 | 2026-07-04 |
| 4 | Yi 1.5 34B 32K | 01.AI | 36.3 | 1 | 2026-07-04 |
| 5 | Yi 1.5 9B 32K | 01.AI | 35.9 | 1 | 2026-07-04 |
| 6 | Qwen 14B B100 | Alibaba | 35.1 | 1 | 2026-07-04 |
| 7 | Yi 1.5 34B Chat 16K | 01.AI | 33.8 | 1 | 2026-07-04 |
| 8 | Yi 1.5 9B Chat | 01.AI | 33.5 | 1 | 2026-07-04 |
| 9 | Yi 9B | 01.AI | 31.8 | 1 | 2026-07-04 |
| 10 | Yi 9B 200K | 01.AI | 31.5 | 1 | 2026-07-04 |
| 11 | Yi 1.5 6B | 01.AI | 31.4 | 1 | 2026-07-04 |
| 12 | Yi 1.5 9B Chat 16K | 01.AI | 30.9 | 1 | 2026-07-04 |
| 13 | smartllama3.1-8B-001 | Meta | 30.6 | 1 | 2026-07-04 |
| 14 | Yi 1.5 6B Chat | 01.AI | 30.2 | 1 | 2026-07-04 |
| 15 | Qwen2.5 7B Test Novelist | Alibaba | 29.1 | 1 | 2026-07-04 |
| 16 | Llama Squared 8B | Meta | 27.2 | 1 | 2026-07-04 |
| 17 | Qwen2.5 1.5B Continuous Learnt | Alibaba | 27 | 1 | 2026-07-04 |
| 18 | Llama 3 Instruct 8B | Meta | 26.6 | 1 | 2026-07-04 |
| 19 | NuminaMath-7B-CoT | AI-MO | 26.6 | 1 | 2026-07-04 |
| 20 | Marco-o1 | AIDC-AI | 25.9 | 1 | 2026-07-04 |
| 21 | NuminaMath-7B-TIR | AI-MO | 25.8 | 1 | 2026-07-04 |
| 22 | Llama 3.1 8B Squareroot | Meta | 25.7 | 1 | 2026-07-04 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.