Vectara HHEM leaderboard — Vectara leaderboard, hallucination-rate metric column
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | finix_s1_32b | antgroup | 1.8 | 1 | 2026-05-02 |
| 2 | GPT-5.4 nano | OpenAI | 3.1 | 1 | 2026-05-02 |
| 3 | Gemini 2.5 Flash Lite | 3.3 | 1 | 2026-05-02 | |
| 4 | Phi 4 | Microsoft | 3.7 | 1 | 2026-05-02 |
| 5 | Llama 3.3 70B Instruct | Meta | 4.1 | 1 | 2026-05-02 |
| 6 | Arctic Instruct | Snowflake | 4.3 | 1 | 2026-05-02 |
| 7 | Gemma 3 12B | 4.4 | 1 | 2026-05-02 | |
| 8 | Mistral Large 2.1 | Mistral | 4.5 | 1 | 2026-05-02 |
| 9 | Qwen3 8B | Alibaba | 4.8 | 1 | 2026-05-02 |
| 10 | Nova Pro (Non-Reasoning) | Amazon | 5.1 | 1 | 2026-05-02 |
| 11 | Mistral Small 3 (Non-Reasoning) | Mistral | 5.1 | 1 | 2026-05-02 |
| 12 | Nova 2.0 Lite | Amazon | 5.1 | 1 | 2026-05-02 |
| 13 | Granite 4.0 H Small | IBM | 5.2 | 2 | 2026-06-19 |
| 14 | Gemma 4 26B A4B IT | 5.2 | 1 | 2026-05-02 | |
| 15 | Jamba Mini 2 | AI21 | 5.3 | 1 | 2026-05-02 |
| 16 | DeepSeek-V3.2-Exp | DeepSeek | 5.3 | 1 | 2026-05-02 |
| 17 | Qwen3 14B | Alibaba | 5.4 | 1 | 2026-05-02 |
| 18 | Nova Micro (Non-Reasoning) | Amazon | 5.5 | 1 | 2026-05-02 |
| 19 | DeepSeek-V3.1 | DeepSeek | 5.5 | 1 | 2026-05-02 |
| 20 | GPT-5.4 mini | OpenAI | 5.5 | 1 | 2026-05-02 |
| 21 | GPT-4.1 | OpenAI | 5.6 | 1 | 2026-05-02 |
| 22 | Qwen3 4B | Alibaba | 5.7 | 1 | 2026-05-02 |
| 23 | Grok 3 | SpaceXAI | 5.8 | 2 | 2026-06-19 |
| 24 | Qwen3 32B | Alibaba | 5.9 | 1 | 2026-05-02 |
| 25 | Nova Lite (Non-Reasoning) | Amazon | 6.1 | 1 | 2026-05-02 |
| 26 | DeepSeek-V3 | DeepSeek | 6.1 | 1 | 2026-05-02 |
| 27 | DeepSeek-V3.2 | DeepSeek | 6.3 | 1 | 2026-05-02 |
| 28 | Gemma 3 4B | 6.4 | 1 | 2026-05-02 | |
| 29 | Trinity Large Thinking | Arcee AI | 6.9 | 1 | 2026-05-02 |
| 30 | Command R+ (Apr '24) | Cohere | 6.9 | 1 | 2026-05-02 |
| 31 | Gemini 2.5 Pro | 7 | 1 | 2026-05-02 | |
| 32 | GPT-5.4 | OpenAI | 7 | 1 | 2026-05-02 |
| 33 | Ministral 3B 2410 | Mistral | 7.3 | 1 | 2026-05-02 |
| 34 | Gemma 4 31B | 7.4 | 1 | 2026-05-02 | |
| 35 | Ministral 8B 2410 | Mistral | 7.4 | 1 | 2026-05-02 |
| 36 | Gemma 3 27B | 7.4 | 1 | 2026-05-02 | |
| 37 | Llama 4 Scout | Meta | 7.7 | 1 | 2026-05-02 |
| 38 | Gemini 2.5 Flash | 7.8 | 1 | 2026-05-02 | |
| 39 | Gemini 3.1 Flash Lite Preview | 8.2 | 1 | 2026-05-02 | |
| 40 | Llama 4 Maverick 17B 128E Instruct FP8 | Meta | 8.2 | 1 | 2026-05-02 |
| 41 | GPT-5.4 Pro | OpenAI | 8.3 | 1 | 2026-05-02 |
| 42 | DeepSeek-V4-Pro | DeepSeek | 8.6 | 1 | 2026-06-29 |
| 43 | MiniMax M2.5 | MiniMax | 9.1 | 1 | 2026-05-02 |
| 44 | GLM-4.5-Air | Z.ai | 9.3 | 1 | 2026-05-02 |
| 45 | Qwen3 235B A22B | Alibaba | 9.3 | 1 | 2026-05-02 |
| 46 | Command A 03-2025 | Cohere | 9.3 | 1 | 2026-05-02 |
| 47 | Qwen3 Next 80B A3B | Alibaba | 9.3 | 1 | 2026-05-02 |
| 48 | GPT-5.5 | OpenAI | 9.3 | 1 | 2026-05-02 |
| 49 | GLM-4.7-Flash | Z.ai | 9.3 | 1 | 2026-05-02 |
| 50 | c4ai-aya-expanse-8b | Cohere | 9.5 | 1 | 2026-05-02 |
| 51 | GLM-4.6 | Z.ai | 9.5 | 1 | 2026-05-02 |
| 52 | NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | 9.6 | 1 | 2026-05-02 |
| 53 | GPT-4o | OpenAI | 9.6 | 1 | 2026-05-02 |
| 54 | Jamba Large 1.7 2025-07 | AI21 | 9.7 | 1 | 2026-05-02 |
| 55 | Claude Haiku 4.5 | Anthropic | 9.8 | 1 | 2026-05-02 |
| 56 | GLM-5 | Z.ai | 10.1 | 1 | 2026-05-02 |
| 57 | Claude Sonnet 4-20250514 (no thinking) | Anthropic | 10.3 | 1 | 2026-06-20 |
| 58 | Claude Sonnet 4 | Anthropic | 10.3 | 1 | 2026-05-02 |
| 59 | Gemini 3.1 Pro | 10.4 | 1 | 2026-05-02 | |
| 60 | Qwen3.5 Flash | Alibaba | 10.5 | 1 | 2026-05-02 |
| 61 | Qwen3.5 35B A3B | Alibaba | 10.5 | 2 | 2026-05-04 |
| 62 | GPT-5 nano | OpenAI | 10.5 | 2 | 2026-06-18 |
| 63 | Claude Sonnet 4.6 | Anthropic | 10.6 | 1 | 2026-05-02 |
| 64 | Granite 3.3 8B Instruct | IBM | 10.6 | 1 | 2026-05-02 |
| 65 | Qwen3.5 Plus 02.15 | Alibaba | 10.7 | 1 | 2026-05-02 |
| 66 | Kimi K2.6 | Moonshot | 10.8 | 1 | 2026-05-12 |
| 67 | GPT-5.2 | OpenAI | 10.8 | 4 | 2026-06-22 |
| 68 | Claude Opus 4.5 | Anthropic | 10.9 | 2 | 2026-06-20 |
| 69 | c4ai-aya-expanse-32b | Cohere | 10.9 | 1 | 2026-05-02 |
| 70 | Qwen3.5 122B A10B | Alibaba | 11.2 | 1 | 2026-05-02 |
| 71 | DeepSeek-R1 | DeepSeek | 11.3 | 1 | 2026-05-02 |
| 72 | GLM-4.7 | Z.ai | 11.7 | 1 | 2026-05-02 |
| 73 | MiniMax M2.1 | MiniMax | 11.8 | 1 | 2026-05-02 |
| 74 | Claude Opus 4.1 | Anthropic | 11.8 | 2 | 2026-06-18 |
| 75 | Claude Opus 4.7 | Anthropic | 12 | 1 | 2026-05-02 |
| 76 | Claude Sonnet 4.5 | Anthropic | 12 | 2 | 2026-05-30 |
| 77 | Claude 4 Opus | Anthropic | 12 | 2 | 2026-06-20 |
| 78 | GPT-5.1 | OpenAI | 12.1 | 4 | 2026-08-10 |
| 79 | Qwen3.5 27B | Alibaba | 12.1 | 1 | 2026-05-02 |
| 80 | Claude Opus 4.6 | Anthropic | 12.2 | 1 | 2026-05-02 |
| 81 | Mercury 2 | Inception | 12.3 | 1 | 2026-05-02 |
| 82 | MiniMax M2.7 | MiniMax | 12.9 | 1 | 2026-05-02 |
| 83 | GPT-5 mini | OpenAI | 12.9 | 1 | 2026-05-02 |
| 84 | Gemini 3 Flash Preview | 13.5 | 1 | 2026-05-02 | |
| 85 | Gemini 3 Pro | 13.6 | 1 | 2026-05-02 | |
| 86 | GPT OSS 120B | OpenAI | 14.2 | 1 | 2026-05-02 |
| 87 | Kimi K2.5 | Moonshot | 14.2 | 1 | 2026-05-02 |
| 88 | Mistral Large 3 | Mistral | 14.5 | 1 | 2026-05-02 |
| 89 | Jamba Mini 1.7 2025-07 | AI21 | 14.7 | 1 | 2026-05-02 |
| 90 | GPT-5 | OpenAI | 14.7 | 4 | 2026-08-10 |
| 91 | Kimi K2 (Reasoning) | Moonshot | 17.9 | 1 | 2026-05-02 |
| 92 | Kimi K2 (Non-Reasoning) | Moonshot | 17.9 | 1 | 2026-06-20 |
| 93 | Kimi K2 Instruct | Moonshot | 17.9 | 1 | 2026-07-06 |
| 94 | o4-mini | OpenAI | 18.6 | 2 | 2026-05-02 |
| 95 | Grok 4.1 Fast | SpaceXAI | 19.2 | 2 | 2026-05-02 |
| 96 | Ministral 3 14B | Mistral | 19.4 | 1 | 2026-05-02 |
| 97 | Grok 4 Fast | SpaceXAI | 20.2 | 2 | 2026-05-02 |
| 98 | Ministral 3 8B | Mistral | 21.7 | 1 | 2026-05-02 |
| 99 | Mistral Medium 3.1 (Non-Reasoning) | Mistral | 22.7 | 2 | 2026-06-23 |
| 100 | o3-pro | OpenAI | 23.3 | 1 | 2026-05-02 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.