Frontier on Instruction Following; strong on Coding; capable on Reasoning and Agentic +2 more; limited on Math and Factuality — at $0.15/M input across 3 providers. Insufficient data on 2 of 10 axes.
| Provider | Model name | Input $/M | Output $/M | Effective | Current |
|---|---|---|---|---|---|
| direct ↗ | qwen3-8-flash-next | $0.15 | $0.47 | 2026-09-02 | ● |
| qwen ↗ | qwen3.8-flash | $0.15 | $0.47 | 2026-09-02 | ● |
| alibaba-official ↗ | qwen3.8-flash | $0.15 | $0.47 | 2026-09-01 | ● |
| Benchmark | Score | Settings | Source | Verification | Methodology | Measured | Reference |
|---|---|---|---|---|---|---|---|
tauBanking | 45.36 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_intelligence_index | 55.81 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_lcr | 77.00 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_omniscience | -9.72 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_mmmu_pro | 79.77 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_scicode | 46.88 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_agentic_index | 56.42 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_coding_index | 73.05 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
omniscienceAccuracy | 24.50 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
aa_hle | 38.04 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
terminalbenchV21 | 86.14 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
omniscienceNonHallucination | 54.68 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
gpqa | 92.32 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ |
| 62.14 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ | |
| 11.14 | reasoning | artificialanalysis.ai | AGGREGATOR | AGGR | 48m ago | view ↗ | |
MathVision | 95.70 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
| 88.50 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 76.60 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 72.30 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 19.40 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 84.50 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 91.90 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
| 81.30 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
Toolathlon | 73.50 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
Job Bench | 55.70 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
NL2Repo | 48.10 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
| 81.00 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
SWE-Bench Pro | 62.50 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
| 58.70 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ | |
livebench_instruction_following@2026-06-25 | 77.11 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_language@2026-06-25 | 74.64 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_math@2026-06-25 | 85.82 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_reasoning@2026-06-25 | 87.38 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_agentic_coding@2026-06-25 | 61.62 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_coding@2026-06-25 | 72.55 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
livebench_data_analysis@2026-06-25 | 74.24 | — | livebench.ai | VERIFIED | OTHER | 23h ago | view ↗ |
| 1619.96 | — | datasets-server.huggingface.coleaderboard-dataset | VERIFIED | OTHER | 2d ago | view ↗ | |
CharXiv (RQ) | 90.60 | — | huggingface.coREADME | VENDOR | OTHER | 6d ago | view ↗ |
| 24.30 | — | huggingface.coREADME | VENDOR | OTHER | 6d ago | view ↗ | |
Toolathlon Verified (Pass@1) | 73.50 | — | huggingface.coREADME | VENDOR | OTHER | 6d ago | view ↗ |
Humanity's Last Exam | 35.90 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
GPQA | 91.70 | — | api.llm-stats.comscores | VENDOR | OTHER | 51m ago | view ↗ |
| 52.30 | — | huggingface.coREADME | VENDOR | OTHER | 6d ago | view ↗ |