Skip to content
VECTOR WIREAI INTELLIGENCE
UTC
Pro Mode — raw scores, one benchmark under the lensthird-party eval harness
The field · 11 measured
82.390.1

11 models measured, most on the third-party eval harness. Claude 3.5 Sonnet tops the board at 90.1.

11 measured·Lifecycle Updated Oct 8, 2026Score basis
#◆Vendor$/M in$/M out
Leader — ignites whiteField — fill cools with scoreBars show 82.3–90.1 · ◆ solid = first-party or better · outlined = arm's-length
01Claude 3.5 SonnetAnthropic90.1$3.0/M$15.0/M$0.100
02Granite 4.1 30BIBM89.65———
03Gemini 1.5 ProGoogle89.4———
04MiniMax Text 01MiniMax89.1———
05Gemini 2.0 Flash ExpGoogle88.4———
06DeepSeek-V3DeepSeek87.3$0.24/M$0.90/M$0.007
07Qwen2.5 Instruct 72BAlibaba87.2$0.47/M$0.49/M$0.006
08Granite 4.1 8BIBM87.06$0.05/M$0.10/M$0.001
09Llama 3.1 Instruct 405BMeta86.4———
10GPT-4oOpenAI84.1$5.0/M$15.0/M$0.119
11Granite 4.1 3BIBM82.3———
◆ solid = independently verified · aggregator attested · vendor attributed — outlined = cross-reference · source-attributed. Dimmed ◆ = confidence inferred. “+N alts” = alternate disclosures in the drawer with why-demoted. Prices per million tokens; $/point = input price ÷ score. Every row opens its model dossier.

Verification: 11 models scored · 0 independently verified · 7 vendor cross-reference · 4 vendor-reported · 0 with source disagreement. How these tiers are assigned