tau3-bench — AA column; banking domain only exists in Sierra tau3-bench (v2 has airline/retail/telecom only); likely same track as TauBench V3 - Banking
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Mistral Medium 3.5 128B | Mistral | 91.4 | 1 | 2026-05-20 |
| 2 | MiMo V2.5 Pro | Xiaomi | 72.9 | 2 | 2026-08-23 |
| 3 | GPT-5.4 | OpenAI | 72.9 | 3 | 2026-06-17 |
| 4 | Claude Opus 4.6 | Anthropic | 72.4 | 2 | 2026-05-18 |
| 5 | Qwen3.6 Plus | Alibaba | 70.7 | 4 | 2026-08-23 |
| 6 | GLM-5.1 | Z.ai | 70.6 | 4 | 2026-08-23 |
| 7 | GLM-5 | Z.ai | 69.2 | 2 | 2026-05-18 |
| 8 | DeepSeek-V3.2 | DeepSeek | 69.2 | 2 | 2026-05-18 |
| 9 | Qwen3.5 35B A3B | Alibaba | 68.9 | 1 | 2026-06-06 |
| 10 | Qwen3.5 27B | Alibaba | 68.4 | 1 | 2026-06-06 |
| 11 | MiniMax M2.7 | MiniMax | 67.6 | 3 | 2026-06-17 |
| 12 | Gemma 4 31B | 67.5 | 2 | 2026-06-17 | |
| 13 | Qwen3.6 35B A3B | Alibaba | 67.2 | 3 | 2026-08-23 |
| 14 | Gemini 3.1 Pro | 67.1 | 3 | 2026-06-17 | |
| 15 | Kimi K2.5 | Moonshot | 66 | 2 | 2026-05-18 |
| 16 | Gemma 4 26B A4B | 59 | 2 | 2026-06-17 | |
| 17 | GPT-5.5 | OpenAI | 31.3 | 5 | 2026-06-21 |
| 18 | Claude Sonnet 4.6 | Anthropic | 30.5 | 1 | 2026-06-17 |
| 19 | Claude Opus 4.7 | Anthropic | 28.9 | 1 | 2026-06-17 |
| 20 | Claude Sonnet 5 | Anthropic | 28.2 | 2 | 2026-07-02 |
| 21 | Claude Opus 4.8 | Anthropic | 27.6 | 1 | 2026-06-17 |
| 22 | GLM-5.2 Full Open Source | Z.ai | 26.8 | 1 | 2026-06-17 |
| 23 | Claude Fable 5 | Anthropic | 26.8 | 1 | 2026-06-17 |
| 24 | DeepSeek-V4-Pro | DeepSeek | 25.8 | 1 | 2026-06-29 |
| 25 | Gemini 3.5 Flash | 25.4 | 1 | 2026-06-17 | |
| 26 | Kimi K2.6 1T A32B | Moonshot | 23.1 | 1 | 2026-06-06 |
| 27 | DeepSeek-V4-Flash | DeepSeek | 22.9 | 1 | 2026-06-17 |
| 28 | Nemotron 3 Ultra 550B A55B | NVIDIA | 22.6 | 2 | 2026-06-17 |
| 29 | GPT-5.4 mini | OpenAI | 21.4 | 1 | 2026-06-17 |
| 30 | GPT-5.4 nano | OpenAI | 21 | 1 | 2026-06-17 |
| 31 | Qwen 3.5 397B 17B | Alibaba | 20.9 | 1 | 2026-06-06 |
| 32 | Kimi K2.6 | Moonshot | 20.6 | 1 | 2026-06-17 |
| 33 | GPT-5 | OpenAI | 19.6 | 1 | 2026-07-04 |
| 34 | Muse Spark | Meta | 19.6 | 1 | 2026-06-17 |
| 35 | Claude Sonnet 4.5 | Anthropic | 19 | 1 | 2026-07-02 |
| 36 | Kimi K2.7 Code | Moonshot | 18.1 | 1 | 2026-06-17 |
| 37 | Qwen3.7 Plus Preview | Alibaba | 17.9 | 1 | 2026-06-17 |
| 38 | Gemini 3 Flash Preview | 17.5 | 1 | 2026-06-17 | |
| 39 | Nex-N2-Pro | Nex AGI | 16.9 | 1 | 2026-06-26 |
| 40 | Qwen3.6 27B | Alibaba | 15.3 | 2 | 2026-07-04 |
| 41 | GPT-5 mini | OpenAI | 14.6 | 1 | 2026-07-04 |
| 42 | MiniMax 2.7 230B A10B | MiniMax | 14.6 | 1 | 2026-06-06 |
| 43 | GPT-5.1 | OpenAI | 14 | 1 | 2026-07-02 |
| 44 | Claude Sonnet 4 | Anthropic | 13.8 | 1 | 2026-07-01 |
| 45 | Qwen3.5 122B A10B | Alibaba | 13.6 | 1 | 2026-06-17 |
| 46 | Qwen3.5 397B A17B | Alibaba | 13.4 | 1 | 2026-06-17 |
| 47 | MiniMax M3 | MiniMax | 13 | 1 | 2026-06-17 |
| 48 | GLM-5.1-744B-A40B | Z.ai | 12.8 | 1 | 2026-06-06 |
| 49 | Grok 4.3 | SpaceXAI | 12.2 | 2 | 2026-06-17 |
| 50 | GPT OSS 120B | OpenAI | 12 | 1 | 2026-06-17 |
| 51 | GPT-5.2 | OpenAI | 12 | 1 | 2026-06-17 |
| 52 | GPT-5.5 Instant | OpenAI | 11.5 | 1 | 2026-07-01 |
| 53 | Step 3.7 Flash | StepFun | 11.3 | 1 | 2026-06-17 |
| 54 | Grok Build 0.1 | SpaceXAI | 10.9 | 1 | 2026-06-24 |
| 55 | Qwen3.7 Max | Alibaba | 10.9 | 1 | 2026-06-17 |
| 56 | GLM-4.6 | Z.ai | 10.5 | 1 | 2026-07-01 |
| 57 | Devstral 2 | Mistral | 10.3 | 1 | 2026-06-26 |
| 58 | Nemotron 3 Super 120B A12B | NVIDIA | 10.1 | 1 | 2026-06-17 |
| 59 | Devstral Small 2 | Mistral | 9.7 | 1 | 2026-06-26 |
| 60 | GLM-4.7 | Z.ai | 9.7 | 1 | 2026-07-02 |
| 61 | Gemini 2.5 Pro | 9.3 | 1 | 2026-06-27 | |
| 62 | Claude Haiku 4.5 | Anthropic | 9.1 | 1 | 2026-06-17 |
| 63 | Nova 2.0 Pro Preview | Amazon | 9.1 | 3 | 2026-06-24 |
| 64 | Gemini 3.1 Flash Lite Preview | 8.7 | 1 | 2026-06-17 | |
| 65 | Mistral Medium 3.1 (Non-Reasoning) | Mistral | 8.5 | 1 | 2026-07-01 |
| 66 | Qwen3.5 9B | Alibaba | 8.2 | 2 | 2026-06-17 |
| 67 | Qwen3.5 4B | Alibaba | 8.2 | 2 | 2026-06-17 |
| 68 | Solar Pro 3 | Upstage | 8 | 1 | 2026-06-17 |
| 69 | Mistral Small 3.1 | Mistral | 7 | 1 | 2026-07-01 |
| 70 | gpt-oss-20b | OpenAI | 7 | 1 | 2026-06-17 |
| 71 | Nova 2.0 Lite | Amazon | 6.8 | 1 | 2026-06-26 |
| 72 | Ministral 3 14B | Mistral | 6.6 | 1 | 2026-06-17 |
| 73 | DeepSeek-R1 | DeepSeek | 6.4 | 1 | 2026-07-01 |
| 74 | Qwen3.5 2B | Alibaba | 6.2 | 2 | 2026-06-17 |
| 75 | Qwen3 Next 80B A3B | Alibaba | 6.2 | 1 | 2026-07-04 |
| 76 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 6 | 1 | 2026-06-26 |
| 77 | Mistral Small 3.2 | Mistral | 6 | 1 | 2026-07-01 |
| 78 | Mistral Large 3 | Mistral | 5.8 | 1 | 2026-06-24 |
| 79 | Command A+ | Cohere | 5.8 | 1 | 2026-07-04 |
| 80 | Claude 3.5 Haiku | Anthropic | 5.8 | 1 | 2026-06-27 |
| 81 | Magistral Medium 1.2 | Mistral | 5.6 | 1 | 2026-06-27 |
| 82 | Qwen3 30B A3B | Alibaba | 5.4 | 1 | 2026-07-02 |
| 83 | Qwen3 14B Instruct | Alibaba | 5.4 | 1 | 2026-07-01 |
| 84 | K2 Think V2 | Moonshot | 5.4 | 1 | 2026-06-29 |
| 85 | Qwen3 32B | Alibaba | 5.4 | 1 | 2026-06-29 |
| 86 | o3-mini | OpenAI | 5.2 | 1 | 2026-07-02 |
| 87 | Mistral Small 4 | Mistral | 5.2 | 1 | 2026-07-04 |
| 88 | GPT-4.1 mini | OpenAI | 5.2 | 1 | 2026-07-02 |
| 89 | Ministral 3 3B | Mistral | 4.7 | 1 | 2026-06-17 |
| 90 | DeepSeek-V3 | DeepSeek | 4.7 | 2 | 2026-07-01 |
| 91 | Qwen3 8B | Alibaba | 4.5 | 1 | 2026-07-01 |
| 92 | Magistral Small 1.2 | Mistral | 4.3 | 1 | 2026-06-27 |
| 93 | MiniCPM-V 4.6 1.3B | OpenBMB | 4.3 | 1 | 2026-06-19 |
| 94 | Llama 4 Maverick | Meta | 3.9 | 1 | 2026-06-21 |
| 95 | Granite 4.1 30B | IBM | 3.9 | 1 | 2026-06-17 |
| 96 | Ministral 3 8B | Mistral | 3.7 | 1 | 2026-06-17 |
| 97 | GPT-4.1 nano | OpenAI | 3.5 | 1 | 2026-07-01 |
| 98 | Llama 4 Scout | Meta | 3.3 | 1 | 2026-06-17 |
| 99 | Granite 4.1 8B | IBM | 3.1 | 1 | 2026-06-17 |
| 100 | MiMo V2 Flash | Xiaomi | 3.1 | 1 | 2026-06-27 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.