AGIEval — IBM Granite spelling of AGIEval; no shot-count/subset given so not merged w/ 5-shot/En variants
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Granite 4.1 30B | IBM | 77.8 | 1 | 2026-06-15 |
| 2 | Granite 4.1 8B | IBM | 72.4 | 1 | 2026-06-15 |
| 3 | Granite 4.1 30B Base | IBM | 69.2 | 2 | 2026-06-15 |
| 4 | Granite 4.1 8B Base | IBM | 61.7 | 2 | 2026-06-15 |
| 5 | Gemma 2 27B IT | 55.1 | 1 | 2026-08-23 | |
| 6 | Granite 4.1 3B Base | IBM | 54.3 | 1 | 2026-06-15 |
| 7 | Gemma 2 Instruct (9B) | 52.8 | 1 | 2026-08-23 | |
| 8 | ERNIE 4.5 | Baidu | 28.5 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.