How many tracked prints does the ARC-Challenge family have?

ARC-Challenge leaderboard — the family board.

3 TRACKED VARIANTS · 1 FIRST-CLASS BOARD

One family, 3 tracked prints. Scoring configs and splits of the base board render as sections of this page, each under its own honest label.

● LIVE DATA53 MODELS ON THIS BOARDLEADER NEMOTRON 3 ULTRA 550B A55B BASE AT 97.3

The board — ARC-ChallengeTOP 53 OF 53 MEASURED · BEST SCORE PER MODEL, DEFAULT VARIANT

#ModelVendorScoreVLast seen

01Nemotron 3 Ultra 550B A55B BaseNVIDIA97.32026-06-05

02Mistral Large 3 675B Base 2512Mistral97.32026-06-05

03MiMo V2.5 Pro BaseXiaomi97.22026-06-05

04MiMo V2.5 ProXiaomi97.22026-08-23

05Llama 3.1 Instruct 405BMeta96.92026-08-23

06Kimi K2 BaseMoonshot96.72026-06-13

07GLM-4.5-BaseZ.ai96.62026-06-05

08MiMo V2.5 BaseXiaomi96.52026-06-05

09Claude 3 OpusAnthropic96.42026-08-23

10Nemotron 3 Super 120B A12BNVIDIA96.12026-08-11

11Hy3-preview-BaseTencent96.02026-06-05

12MiMo V2 Flash BaseXiaomi95.92026-06-13

13DeepSeek-V3.1-BaseDeepSeek95.62026-06-13

14DeepSeek-V3.2-Exp-BaseDeepSeek95.52026-06-13

15Qwen3.5 35B A3BAlibaba95.42026-08-11

16DeepSeek-V3DeepSeek95.32026-05-01

17Hunyuan LargeTencent952026-05-31

18Llama 3.1 70B InstructMeta94.82026-08-23

19Nova ProAmazon94.82026-09-01

20DeepSeek-V3-BaseDeepSeek94.72026-06-05

21Hunyuan Large InstructTencent94.62026-05-31

22Qwen2.5 Instruct 72BAlibaba94.52026-05-01

23Claude 3 SonnetAnthropic93.22026-08-23

24Jamba 1.5 LargeAI21932026-08-23

25Gemma 4 26B A4BGoogle92.82026-08-11

26Nemotron 3.5 LightningNVIDIA92.72026-08-11

27Nova LiteAmazon92.42026-09-01

28DeepSeek-V2DeepSeek92.42026-09-10

29NVIDIA Nemotron 3 Nano 30B A3BNVIDIA92.02026-08-11

30Claude 2Anthropic912026-07-17

31Phi 3.5 MoE InstructMicrosoft912026-08-23

32Nova MicroAmazon90.22026-09-01

33Claude 1.3Anthropic902026-07-17

34Claude 3 HaikuAnthropic89.22026-08-23

35Phi 3 Mini 4K InstructMicrosoft86.32026-08-29

36Jamba 1.5 MiniAI2185.72026-08-23

37Phi 3.5 Mini InstructMicrosoft84.62026-08-23

38Phi 4 Mini InstructMicrosoft83.72026-08-23

39Llama 3.1 8B InstructMeta83.42026-08-23

40Llama 3 Instruct 8BMeta82.82026-08-29

41Mistral 7BMistral78.62026-08-29

42Llama 3.2 3B InstructMeta78.62026-08-23

43Gemma (7B)Google78.32026-08-29

44Gemma 2 27B ITGoogle71.42026-08-23

45Command R+ (Apr '24)Cohere71.02026-08-23

46Qwen 2.5 Coder 32B InstructAlibaba70.52026-08-23

47Llama 3.1 Nemotron Instruct 70BNVIDIA69.22026-08-23

48Qwen2 Instruct (72B)Alibaba68.92026-08-23

49Qwen2 72BAlibaba68.92026-09-10

50Llama 3 (70B)Meta68.82026-09-10

51Gemma 2 Instruct (9B)Google68.42026-08-23

52Gemma 3n E2B InstructGoogle51.72026-09-10

53ERNIE 4.5Baidu40.62026-08-23

◆ IV — INDEPENDENTLY VERIFIED · ◆ AA — AGGREGATOR · ◆ VA — VENDOR · ◇ SA — SOURCE-ATTRIBUTED

Variants of this boardSCORING CONFIGS & SPLITS — NOT CITED STANDALONE, SO THEY LIVE HERE

Other tracked prints

THIN BOARDSunder 5 published models each — listed, never hidden

PrintLeaderScoreModels

ARC-Challenge (Acc.)DeepSeek-V395.34

ARC-Easy (Acc.)DeepSeek-V398.94

THE FAMILY BOARD · EVERY PRINT LABELED · EVERY SCORE SOURCE-ATTRIBUTED ON ITS OWN LIVE BOARDAll leaderboards The frontier board Models by vendor