VECTOR WIREAI INTELLIGENCE
NVDA$1,847+3.2%MSFT$512+1.1%GOOGL$199-0.4%META$728+2.7%AMD$184-1.2%TSM$212+0.6%PLTR$98+4.1%AI IDX4,821+1.9%
PKT
SEEDRefresh Models Deals Regulatory Sources

mmmlu

75 models tracked

MMMLU (OpenAI Multilingual MMLU) — OpenAI's human-translated multilingual MMLU across 14 languages.

#ModelVendorBest scoreRunsLast seen
1Claude Mythos 5Anthropic92.712026-08-23
2Gemini 3.1 ProGoogle92.642026-08-23
3Gemini 3 Flash PreviewGoogle91.812026-08-23
4Gemini 3 ProGoogle91.832026-08-23
5Claude Opus 4.7Anthropic91.532026-08-23
6Claude Opus 4.6Anthropic91.142026-08-23
7GPT-5.1OpenAI9112026-07-29
8Claude Opus 4.5Anthropic90.832026-08-23
9Qwen3.7 MaxAlibaba90.312026-08-23
10GPT-5.2OpenAI89.622026-08-23
11Claude Opus 4.1Anthropic89.522026-08-23
12Qwen3.6 PlusAlibaba89.512026-08-23
13Claude Sonnet 4.6Anthropic89.322026-08-23
14Claude Sonnet 4.5Anthropic89.122026-08-23
15Qwen3.7 Plus PreviewAlibaba8912026-08-23
16Gemini 3.1 Flash Lite PreviewGoogle88.912026-08-23
17Claude 4 OpusAnthropic88.822026-08-23
18Qwen3.5 397B A17BAlibaba88.512026-08-23
19Gemma 4 31BGoogle88.4272026-08-23
20o1OpenAI87.712026-08-23
21GPT-4.1OpenAI87.312026-08-23
22Qwen3.5 122B A10BAlibaba86.712026-08-23
23Qwen3 235B A22BAlibaba86.712026-08-23
24Claude Sonnet 4Anthropic86.522026-08-23
25Gemma 4 26B A4BGoogle86.3272026-08-23
26Claude 3.7 SonnetAnthropic86.112026-08-23
27Qwen3.5 27BAlibaba85.912026-08-23
28Mistral Large 3 675B Base 2512Mistral85.512026-08-23
29Mistral LargeMistral85.512026-08-23
30Qwen3.5 35B A3BAlibaba85.212026-08-23
31GPT-4.5 PreviewOpenAI85.112026-08-23
32Gemma 4 12BGoogle83.4272026-08-23
33Claude Haiku 4.5Anthropic8312026-08-23
34GPT-4oOpenAI81.412026-08-23
35Qwen3.5 9BAlibaba81.212026-08-23
36Hy3 preview-BaseTencent80.222026-06-05
37DeepSeek-V3-BaseDeepSeek79.522026-06-05
38DeepSeek-V3DeepSeek79.412026-07-06
39GLM-4.5-BaseZ.ai79.322026-06-05
40Qwen3 32BAlibaba7912026-06-15
41Qwen3 30B A3BAlibaba7912026-06-15
42GPT-4.1 miniOpenAI78.512026-08-23
43Seed Oss 36B InstructByteDance78.412026-06-15
44Kimi K2 BaseMoonshot77.622026-06-05
45Gemma 4 E4BGoogle76.6322026-08-23
46Qwen3.5 4BAlibaba76.112026-08-23
47Qwen2.5 Instruct 72BAlibaba74.812026-07-06
48Mistral Large 3Mistral74.212026-08-23
49Llama 3.1 Instruct 405BMeta73.812026-07-06
50Granite 4.1 30BIBM73.712026-06-15
51Granite 4.1 30B BaseIBM73.422026-06-15
52Gemma 3 27BGoogle70.7272026-07-10
53Phi 3.5 MoE InstructMicrosoft69.912026-08-23
54Gemma 4 E2BGoogle67.4372026-08-23
55GPT-4.1 nanoOpenAI66.912026-08-23
56Qwen2.5 7B BaseAlibaba65.512026-05-03
57Granite 4.1 8BIBM64.812026-06-15
58Granite 4.1 8B BaseIBM64.722026-06-15
59DeepSeek-V2DeepSeek6412026-07-06
60Qwen3.5 2BAlibaba63.112026-08-23
61Qwen2.5 3B BaseAlibaba59.612026-05-03
62Granite 4.1 3B BaseIBM56.612026-06-15
63Phi 3.5 Mini InstructMicrosoft55.412026-08-23
64LFM2 2.6BLiquid AI55.412026-08-09
65Qwen3 4B Base DenseAlibaba50.212026-05-03
66Gemma 3 4BGoogle50.112026-08-09
67Llama 3.2 3B InstructMeta47.912026-08-09
68LFM2 1.2BLiquid AI46.712026-08-09
69Qwen3 1.7BAlibaba46.512026-08-09
70Qwen3.5 0.8BAlibaba44.312026-08-23
71LFM2-700MLiquid AI43.312026-08-09
72LFM2-350MLiquid AI3812026-08-09
73Gemma 3 1B ITGoogle34.412026-08-09
74Qwen3 0.6BAlibaba30.812026-08-09
75Gemma 3 1B Base DenseGoogle26.612026-05-03

Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.