ERQA (Embodied Reasoning QA) — Embodied-reasoning visual QA benchmark (Google-origin).
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Qwen3.8 Max Preview | Alibaba | 77.8 | 1 | 2026-08-23 |
| 2 | Qwen3.7 Plus Preview | Alibaba | 69.8 | 2 | 2026-08-24 |
| 3 | Qwen3.5 397B A17B | Alibaba | 67.5 | 1 | 2026-08-24 |
| 4 | Qwen3.6 Plus | Alibaba | 65.7 | 1 | 2026-08-23 |
| 5 | GPT-5 | OpenAI | 65.7 | 1 | 2026-08-23 |
| 6 | Qwen3.8 27B | Alibaba | 65.5 | 2 | 2026-08-24 |
| 7 | Qwen3.5 35B A3B | Alibaba | 64.8 | 1 | 2026-08-23 |
| 8 | Muse Spark | Meta | 64.7 | 1 | 2026-08-23 |
| 9 | o3 | OpenAI | 64 | 1 | 2026-08-23 |
| 10 | Qwen3.6 27B | Alibaba | 62.5 | 3 | 2026-08-24 |
| 11 | Qwen3.5 122B A10B | Alibaba | 62 | 1 | 2026-08-23 |
| 12 | Qwen3.5 27B | Alibaba | 60.5 | 2 | 2026-08-24 |
| 13 | Gemma 4 31B | 57.5 | 1 | 2026-08-24 | |
| 14 | HY-Embodied 0.5 MoT-2B | Tencent | 54.5 | 1 | 2026-06-15 |
| 15 | Qwen3 VL 235B A22B Reasoning | Alibaba | 52.5 | 1 | 2026-08-23 |
| 16 | Qwen3 VL 32B Reasoning | Alibaba | 52.3 | 1 | 2026-08-23 |
| 17 | Qwen3 VL 235B A22B Instruct | Alibaba | 51.3 | 1 | 2026-08-23 |
| 18 | Qwen3 VL 32B Instruct | Alibaba | 48.8 | 1 | 2026-08-23 |
| 19 | Qwen3 VL 4B (Reasoning) | Alibaba | 47.3 | 2 | 2026-08-23 |
| 20 | MiMo Embodied 7B | Xiaomi | 46.8 | 1 | 2026-06-15 |
| 21 | Claude Opus 4.5 | Anthropic | 46.8 | 1 | 2026-08-24 |
| 22 | Qwen3 VL Thinking (8B) | Alibaba | 46.8 | 1 | 2026-08-23 |
| 23 | Qwen3 VL 8B Instruct | Alibaba | 45.8 | 1 | 2026-08-23 |
| 24 | Qwen3 VL 30B A3B Reasoning | Alibaba | 45.3 | 1 | 2026-08-23 |
| 25 | Qwen3 VL 30B A3B Instruct | Alibaba | 43 | 1 | 2026-08-23 |
| 26 | Qwen3 VL 2B | Alibaba | 41.8 | 1 | 2026-06-15 |
| 27 | Qwen3 VL 4B Instruct | Alibaba | 41.3 | 1 | 2026-08-23 |
| 28 | Claude Opus 4.6 | Anthropic | 40.8 | 1 | 2026-08-24 |
| 29 | GPT-4o | OpenAI | 35.2 | 1 | 2026-08-23 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.