BIG-Bench Extra Hard — Standard acronym for BIG-Bench Extra Hard; distinct from plain bbh (=BIG-Bench Hard, diff task set)
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemma 4 31B | 74.4 | 27 | 2026-08-23 | |
| 2 | Gemma 4 26B A4B | 64.8 | 27 | 2026-08-23 | |
| 3 | Gemma 4 12B | 53 | 27 | 2026-08-23 | |
| 4 | Gemma 4 E4B | 33.1 | 32 | 2026-08-23 | |
| 5 | SynLogic Mix 3 32B | MiniMax | 28.6 | 1 | 2026-06-05 |
| 6 | SynLogic 32B | MiniMax | 25.5 | 1 | 2026-06-05 |
| 7 | Gemma 4 E2B | 21.9 | 36 | 2026-08-23 | |
| 8 | Gemma 3 27B | 19.3 | 28 | 2026-08-23 | |
| 9 | DeepSeek-R1-Distill-Qwen-32B | DeepSeek | 19.2 | 2 | 2026-06-05 |
| 10 | Qwen2.5 Instruct 32B | Alibaba | 17.5 | 1 | 2026-06-05 |
| 11 | Gemma 3 12B | 16.3 | 1 | 2026-08-23 | |
| 12 | Gemma 3 4B | 11 | 1 | 2026-08-23 | |
| 13 | SynLogic 7B | MiniMax | 8 | 1 | 2026-06-05 |
| 14 | Gemma 3 1B | 7.2 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.