VECTOR WIREAI INTELLIGENCE
⌘K
NVDA$1,847+3.2%MSFT$512+1.1%GOOGL$199-0.4%META$728+2.7%AMD$184-1.2%TSM$212+0.6%PLTR$98+4.1%AI IDX4,821+1.9%
PKT
SEEDRefresh Models —Deals —Regulatory —Sources —

vectara_avg_summary_length

100 models tracked

Vectara HHEM leaderboard — Vectara leaderboard, summary-length metric column (not accuracy)

#ModelVendorBest scoreRunsLast seen
1Phi 4 Mini InstructMicrosoft420.222026-06-19
2GPT-5.1OpenAI254.442026-08-10
3Ministral 8B 2410Mistral19612026-05-02
4GPT-5.2OpenAI186.342026-06-22
5Grok 4 FastSpaceXAI173.922026-05-02
6finix_s1_32bantgroup172.412026-05-02
7GPT-5 miniOpenAI169.712026-05-02
8Ministral 3B 2410Mistral167.912026-05-02
9GPT-5OpenAI162.742026-08-10
10DeepSeek-V4-ProDeepSeek153.812026-06-29
11Claude Opus 4.7Anthropic149.112026-05-02
12Mercury 2Inception149.112026-05-02
13GPT-5.4 ProOpenAI148.512026-05-02
14Claude Sonnet 4Anthropic145.812026-05-02
15Claude Sonnet 4-20250514 (no thinking)Anthropic145.812026-06-20
16GPT-5.4 nanoOpenAI144.412026-05-02
17Mistral Medium 3.1 (Non-Reasoning)Mistral142.922026-06-23
18Ministral 3 8BMistral139.412026-05-02
19Claude Opus 4.6Anthropic137.612026-05-02
20Llama 4 ScoutMeta137.312026-05-02
21MiniMax M2.5MiniMax137.212026-05-02
22Jamba Mini 1.7 2025-07AI21136.412026-05-02
23Ministral 3 14BMistral135.812026-05-02
24GPT OSS 120BOpenAI135.212026-05-02
25MiniMax M2.7MiniMax131.912026-05-02
26Granite 3.3 8B InstructIBM131.412026-05-02
27o4-miniOpenAI130.922026-05-02
28GPT-5.5OpenAI129.612026-05-02
29Claude Opus 4.1Anthropic129.122026-06-18
30Claude Sonnet 4.5Anthropic127.822026-05-30
31o3-proOpenAI127.412026-05-02
32Jamba Large 1.7 2025-07AI21124.812026-05-02
33Claude 4 OpusAnthropic123.222026-06-20
34Phi 4Microsoft120.912026-05-02
35Trinity Large ThinkingArcee AI117.312026-05-02
36Kimi K2.6Moonshot116.712026-05-12
37Qwen3 32BAlibaba115.812026-05-02
38Claude Haiku 4.5Anthropic115.112026-05-02
39Claude Sonnet 4.6Anthropic114.712026-05-02
40Claude Opus 4.5Anthropic114.522026-06-20
41Mistral Large 3Mistral112.712026-05-02
42c4ai-aya-expanse-32bCohere112.712026-05-02
43Kimi K2.5Moonshot11212026-05-02
44Qwen3 14BAlibaba111.112026-05-02
45Jamba Mini 2AI21109.412026-05-02
46Gemini 3.1 ProGoogle107.712026-05-02
47Granite 4.0 H SmallIBM107.422026-06-19
48MiniMax M2.1MiniMax106.912026-05-02
49Gemini 2.5 ProGoogle106.412026-05-02
50Llama 4 Maverick 17B 128E Instruct FP8Meta10612026-05-02
51GPT-5 nanoOpenAI105.722026-06-18
52Qwen3 235B A22BAlibaba105.612026-05-02
53Qwen3 4BAlibaba104.712026-05-02
54NVIDIA Nemotron 3 Nano 30B A3BNVIDIA104.212026-05-02
55Gemini 3 ProGoogle101.912026-05-02
56Command A 03-2025Cohere101.712026-05-02
57Gemini 2.5 FlashGoogle101.512026-05-02
58Nova Micro (Non-Reasoning)Amazon10012026-05-02
59Grok 4.1 FastSpaceXAI99.522026-05-02
60Mistral Small 3 (Non-Reasoning)Mistral98.812026-05-02
61Gemma 3 27BGoogle96.412026-05-02
62Grok 3SpaceXAI95.922026-06-19
63Gemini 2.5 Flash LiteGoogle95.712026-05-02
64Qwen3.5 FlashAlibaba9512026-05-02
65Qwen3.5 35B A3BAlibaba94.922026-05-04
66Qwen3.5 27BAlibaba94.412026-05-02
67Nova 2.0 LiteAmazon94.112026-05-02
68DeepSeek-R1DeepSeek93.512026-05-02
69Qwen3.5 Plus 02.15Alibaba92.112026-05-02
70Nova Lite (Non-Reasoning)Amazon91.812026-05-02
71GPT-4.1OpenAI91.712026-05-02
72Command R+ (Apr '24)Cohere91.512026-05-02
73Gemini 3 Flash PreviewGoogle90.212026-05-02
74Gemma 3 12BGoogle89.712026-05-02
75c4ai-aya-expanse-8bCohere88.212026-05-02
76GPT-4oOpenAI86.612026-05-02
77Qwen3.5 122B A10BAlibaba86.412026-05-02
78Mistral Large 2.1Mistral8512026-05-02
79Qwen3 8BAlibaba83.612026-05-02
80GPT-5.4OpenAI81.712026-05-02
81DeepSeek-V3DeepSeek81.712026-05-02
82Arctic InstructSnowflake81.412026-05-02
83Gemma 3 4BGoogle77.412026-05-02
84GLM-4.6Z.ai77.212026-05-02
85Gemma 4 31BGoogle75.812026-05-02
86GLM-5Z.ai74.412026-05-02
87GLM-4.7-FlashZ.ai71.812026-05-02
88Qwen3 Next 80B A3BAlibaba70.912026-05-02
89GLM-4.5-AirZ.ai70.612026-05-02
90GLM-4.7Z.ai70.612026-05-02
91Gemma 4 26B A4B ITGoogle67.112026-05-02
92Nova Pro (Non-Reasoning)Amazon66.212026-05-02
93Llama 3.3 70B InstructMeta64.612026-05-02
94DeepSeek-V3.2-ExpDeepSeek64.612026-05-02
95DeepSeek-V3.1DeepSeek63.712026-05-02
96Gemini 3.1 Flash Lite PreviewGoogle62.612026-05-02
97DeepSeek-V3.2DeepSeek6212026-05-02
98Kimi K2 (Non-Reasoning)Moonshot59.212026-06-20
99Kimi K2 (Reasoning)Moonshot59.212026-05-02
100Kimi K2 InstructMoonshot59.212026-07-06

Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.