VECTOR WIREAI INTELLIGENCE
NVDA$1,847+3.2%MSFT$512+1.1%GOOGL$199-0.4%META$728+2.7%AMD$184-1.2%TSM$212+0.6%PLTR$98+4.1%AI IDX4,821+1.9%
PKT
SEEDRefresh Models Deals Regulatory Sources

vectara_hallucination_rate

100 models tracked↓ lower is better

Vectara HHEM leaderboard — Vectara leaderboard, hallucination-rate metric column

#ModelVendorBest scoreRunsLast seen
1finix_s1_32bantgroup1.812026-05-02
2GPT-5.4 nanoOpenAI3.112026-05-02
3Gemini 2.5 Flash LiteGoogle3.312026-05-02
4Phi 4Microsoft3.712026-05-02
5Llama 3.3 70B InstructMeta4.112026-05-02
6Arctic InstructSnowflake4.312026-05-02
7Gemma 3 12BGoogle4.412026-05-02
8Mistral Large 2.1Mistral4.512026-05-02
9Qwen3 8BAlibaba4.812026-05-02
10Nova Pro (Non-Reasoning)Amazon5.112026-05-02
11Mistral Small 3 (Non-Reasoning)Mistral5.112026-05-02
12Nova 2.0 LiteAmazon5.112026-05-02
13Granite 4.0 H SmallIBM5.222026-06-19
14Gemma 4 26B A4B ITGoogle5.212026-05-02
15Jamba Mini 2AI215.312026-05-02
16DeepSeek-V3.2-ExpDeepSeek5.312026-05-02
17Qwen3 14BAlibaba5.412026-05-02
18Nova Micro (Non-Reasoning)Amazon5.512026-05-02
19DeepSeek-V3.1DeepSeek5.512026-05-02
20GPT-5.4 miniOpenAI5.512026-05-02
21GPT-4.1OpenAI5.612026-05-02
22Qwen3 4BAlibaba5.712026-05-02
23Grok 3SpaceXAI5.822026-06-19
24Qwen3 32BAlibaba5.912026-05-02
25Nova Lite (Non-Reasoning)Amazon6.112026-05-02
26DeepSeek-V3DeepSeek6.112026-05-02
27DeepSeek-V3.2DeepSeek6.312026-05-02
28Gemma 3 4BGoogle6.412026-05-02
29Trinity Large ThinkingArcee AI6.912026-05-02
30Command R+ (Apr '24)Cohere6.912026-05-02
31Gemini 2.5 ProGoogle712026-05-02
32GPT-5.4OpenAI712026-05-02
33Ministral 3B 2410Mistral7.312026-05-02
34Gemma 4 31BGoogle7.412026-05-02
35Ministral 8B 2410Mistral7.412026-05-02
36Gemma 3 27BGoogle7.412026-05-02
37Llama 4 ScoutMeta7.712026-05-02
38Gemini 2.5 FlashGoogle7.812026-05-02
39Gemini 3.1 Flash Lite PreviewGoogle8.212026-05-02
40Llama 4 Maverick 17B 128E Instruct FP8Meta8.212026-05-02
41GPT-5.4 ProOpenAI8.312026-05-02
42DeepSeek-V4-ProDeepSeek8.612026-06-29
43MiniMax M2.5MiniMax9.112026-05-02
44GLM-4.5-AirZ.ai9.312026-05-02
45Qwen3 235B A22BAlibaba9.312026-05-02
46Command A 03-2025Cohere9.312026-05-02
47Qwen3 Next 80B A3BAlibaba9.312026-05-02
48GPT-5.5OpenAI9.312026-05-02
49GLM-4.7-FlashZ.ai9.312026-05-02
50c4ai-aya-expanse-8bCohere9.512026-05-02
51GLM-4.6Z.ai9.512026-05-02
52NVIDIA Nemotron 3 Nano 30B A3BNVIDIA9.612026-05-02
53GPT-4oOpenAI9.612026-05-02
54Jamba Large 1.7 2025-07AI219.712026-05-02
55Claude Haiku 4.5Anthropic9.812026-05-02
56GLM-5Z.ai10.112026-05-02
57Claude Sonnet 4-20250514 (no thinking)Anthropic10.312026-06-20
58Claude Sonnet 4Anthropic10.312026-05-02
59Gemini 3.1 ProGoogle10.412026-05-02
60Qwen3.5 FlashAlibaba10.512026-05-02
61Qwen3.5 35B A3BAlibaba10.522026-05-04
62GPT-5 nanoOpenAI10.522026-06-18
63Claude Sonnet 4.6Anthropic10.612026-05-02
64Granite 3.3 8B InstructIBM10.612026-05-02
65Qwen3.5 Plus 02.15Alibaba10.712026-05-02
66Kimi K2.6Moonshot10.812026-05-12
67GPT-5.2OpenAI10.842026-06-22
68Claude Opus 4.5Anthropic10.922026-06-20
69c4ai-aya-expanse-32bCohere10.912026-05-02
70Qwen3.5 122B A10BAlibaba11.212026-05-02
71DeepSeek-R1DeepSeek11.312026-05-02
72GLM-4.7Z.ai11.712026-05-02
73MiniMax M2.1MiniMax11.812026-05-02
74Claude Opus 4.1Anthropic11.822026-06-18
75Claude Opus 4.7Anthropic1212026-05-02
76Claude Sonnet 4.5Anthropic1222026-05-30
77Claude 4 OpusAnthropic1222026-06-20
78GPT-5.1OpenAI12.142026-08-10
79Qwen3.5 27BAlibaba12.112026-05-02
80Claude Opus 4.6Anthropic12.212026-05-02
81Mercury 2Inception12.312026-05-02
82MiniMax M2.7MiniMax12.912026-05-02
83GPT-5 miniOpenAI12.912026-05-02
84Gemini 3 Flash PreviewGoogle13.512026-05-02
85Gemini 3 ProGoogle13.612026-05-02
86GPT OSS 120BOpenAI14.212026-05-02
87Kimi K2.5Moonshot14.212026-05-02
88Mistral Large 3Mistral14.512026-05-02
89Jamba Mini 1.7 2025-07AI2114.712026-05-02
90GPT-5OpenAI14.742026-08-10
91Kimi K2 (Reasoning)Moonshot17.912026-05-02
92Kimi K2 (Non-Reasoning)Moonshot17.912026-06-20
93Kimi K2 InstructMoonshot17.912026-07-06
94o4-miniOpenAI18.622026-05-02
95Grok 4.1 FastSpaceXAI19.222026-05-02
96Ministral 3 14BMistral19.412026-05-02
97Grok 4 FastSpaceXAI20.222026-05-02
98Ministral 3 8BMistral21.712026-05-02
99Mistral Medium 3.1 (Non-Reasoning)Mistral22.722026-06-23
100o3-proOpenAI23.312026-05-02

Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.