Limited on Multimodal. Insufficient data on 9 of 10 axes.
| Benchmark | Score | Settings | Source | Verification | Methodology | Measured | Reference |
|---|---|---|---|---|---|---|---|
Human Eval | 91.50 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 84.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
GPQA-diamond | 46.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 82.20 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
MMLU-PRO | 68.80 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
MMLU | 78.40 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
OSWorld | 5.92 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 22.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
ScreenSpot Pro | 39.40 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
ScreenSpot | 88.50 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
Android Control | 93.30 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
AITZ | 83.10 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
MMBench-Video | 1.93 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
VideoMME | 77.90 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
CharadesSTA | 54.20 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 49.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
InfoVQA | 83.40 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
DocVQA | 94.80 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 77.10 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
OCRBenchV2 | 59.10 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
MathVision | 40.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 74.70 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
| 69.50 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
MMMU Pro | 49.50 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ |
| 70.00 | — | huggingface.coREADME | VENDOR | OTHER | 20h ago | view ↗ | |
| 1152.56 | — | datasets-server.huggingface.coleaderboard-dataset | VERIFIED | OTHER | 21h ago | view ↗ |