Which model leads BigBenchHard?

Q: Which model leads BigBenchHard?

Llama 3.1 8B Instruct tops the board at 73.43

BigBenchHard Leaderboard — Model Scores

Pro Mode — raw scores, one benchmark under the lensthird-party eval harness

The field · 9 measured

61.3973.43

9 models measured, most on the third-party eval harness. Llama 3.1 8B Instruct tops the board at 73.43.

9 measured·Lifecycle Updated Oct 8, 2026Score basis

#◆Vendor$/M in$/M out

Leader — ignites whiteField — fill cools with scoreIndependently verified only0 of 9Bars show 61.39–73.43 · ◆ solid = first-party or better · outlined = arm's-length

01Llama 3.1 8B InstructMeta73.43$0.02/M$0.04/M$0.000

02Granite 3.2 8B InstructIBM71.86———

03Granite 3.1 8B InstructIBM69.87———

04Granite 3.3 8B InstructIBM69.13$0.03/M$0.25/M$0.002

05DeepSeek-R1-Distill-Llama-8BDeepSeek67.39$0.05/M$0.05/M$0.001

06DeepSeek-R1-Distill-Qwen-7BDeepSeek67.38$0.15/M$0.15/M$0.002

07Granite 3.3 2B InstructIBM63.91———

08Granite 3.1 2B InstructIBM61.82———

09Granite 3.2 2B InstructIBM61.39———

◆ solid = independently verified · aggregator attested · vendor attributed — outlined = cross-reference · source-attributed. Dimmed ◆ = confidence inferred. “+N alts” = alternate disclosures in the drawer with why-demoted. Prices per million tokens; $/point = input price ÷ score. Every row opens its model dossier.

Verification: 9 models scored · 0 independently verified · 8 vendor cross-reference · 1 vendor-reported · 0 with source disagreement. How these tiers are assigned