VideoMMMU — Distinct named video-MMMU benchmark; pass@1 variant present across Kimi cards
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 3 Pro | 87.6 | 2 | 2026-08-23 | |
| 2 | Gemini 3 Flash Preview | 86.9 | 1 | 2026-08-23 | |
| 3 | Kimi K2.5 | Moonshot | 86.6 | 2 | 2026-08-23 |
| 4 | GPT-5.2 | OpenAI | 85.9 | 2 | 2026-08-23 |
| 5 | Qwen3.7 Plus Preview | Alibaba | 85.4 | 1 | 2026-08-23 |
| 6 | Gemini 3.1 Flash Lite Preview | 84.8 | 1 | 2026-08-23 | |
| 7 | Qwen3.5 397B A17B | Alibaba | 84.7 | 1 | 2026-08-24 |
| 8 | MiniMax M3 | MiniMax | 84.6 | 1 | 2026-08-23 |
| 9 | GPT-5 | OpenAI | 84.6 | 1 | 2026-08-23 |
| 10 | Qwen3.6 27B | Alibaba | 84.4 | 2 | 2026-08-24 |
| 11 | Claude Opus 4.5 | Anthropic | 84.4 | 2 | 2026-08-24 |
| 12 | Qwen3.6 Plus | Alibaba | 84 | 1 | 2026-08-23 |
| 13 | Qwen3.6 35B A3B | Alibaba | 83.7 | 1 | 2026-08-23 |
| 14 | Gemini 2.5 Pro Preview 06.05 (32k think) | 83.6 | 1 | 2026-08-24 | |
| 15 | o3 | OpenAI | 83.3 | 1 | 2026-08-23 |
| 16 | Qwen3.5 27B | Alibaba | 82.3 | 2 | 2026-08-24 |
| 17 | Qwen3.5 122B A10B | Alibaba | 82 | 1 | 2026-08-23 |
| 18 | Qwen3.5 35B A3B | Alibaba | 80.4 | 1 | 2026-08-23 |
| 19 | Qwen3 VL 235B A22B Reasoning | Alibaba | 80 | 2 | 2026-08-23 |
| 20 | Qwen3 VL 32B Reasoning | Alibaba | 79 | 1 | 2026-08-23 |
| 21 | Qwen3 VL 30B A3B Reasoning | Alibaba | 75 | 1 | 2026-08-23 |
| 22 | Qwen3 VL 235B A22B Instruct | Alibaba | 74.7 | 1 | 2026-08-23 |
| 23 | Qwen3 VL Thinking (8B) | Alibaba | 72.8 | 1 | 2026-08-23 |
| 24 | Qwen3 VL 4B (Reasoning) | Alibaba | 69.4 | 1 | 2026-08-23 |
| 25 | Qwen3 VL 30B A3B Instruct | Alibaba | 68.7 | 1 | 2026-08-23 |
| 26 | Qwen3 VL 8B Instruct | Alibaba | 65.3 | 1 | 2026-08-23 |
| 27 | GPT-4o | OpenAI | 61.2 | 1 | 2026-08-23 |
| 28 | Qwen3 VL 4B Instruct | Alibaba | 56.2 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.