Refresh Models —Deals —Regulatory —Sources —

Llama 3.1 Instruct 405B vs Nemotron 3 Ultra 550B A55B

19 SHARED BENCHMARKS

Across 19 shared benchmarks, Llama 3.1 Instruct 405B scores higher on 1 and Nemotron 3 Ultra 550B A55B on 18. The widest gap is HLE, where Nemotron 3 Ultra 550B A55B scores 37.4 against 4.2.

METAVSNVIDIA19 SHARED1–18 HEAD-TO-HEAD

BenchmarkLlama 3.1 Instruct 405BMARGINNemotron 3 Ultra 550B A55B

AA Agentic Index6.327.5

AA Intelligence8.538.3

AA-LCR24.771

AA-Omniscience-17.1-0.4

Artificial Analysis Coding Index14.549.3

GPQA Diamond51.587

HLE4.237.4

longbench_v236.161.9

MMLU-Pro73.486.8

OmniScience Accuracy23.222.6

OmniScience Non-Hallucination4970.3

scicode29.944.6

simplebench2341.7

SWE-bench Verified24.570.7

Terminal-Bench Hard6.836.4

τ²-Bench Telecom (AA run)1983.3

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.

Compare Llama 3.1 Instruct 405B withEVERY TRACKED PAIRING

▶Anthropic12 PAIRINGS

Claude Opus 4.8 Claude Opus 4.6 Claude Sonnet 4.5 Claude 3.5 Sonnet Claude Fable 5 Claude Opus 4.5 Claude Opus 5 Claude Opus 4.7 Claude Sonnet 4 Claude Sonnet 4.6 Claude Sonnet 5 Claude Opus 4

▶OpenAI11 PAIRINGS

GPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.2 GPT-5.4 GPT-5 o3 GPT-5.1 o4-mini o1 GPT-4o mini

▶Google11 PAIRINGS

Gemini 3.1 Pro Gemini 3 Pro Gemma 4 26B A4B Gemini 2.5 Pro Gemini 1.5 Pro Gemma 4 31B Gemini 3.5 Flash Gemini 3 Flash Preview Gemini 3.6 Flash Gemma 4 E2B Gemini 2.5 Flash

▶Alibaba11 PAIRINGS

Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3 VL 4B (Reasoning)Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus Qwen3.6 27B Qwen3.6 35B A3B Qwen3.7 Max Qwen3.5 122B A10B Qwen3.7 Plus Preview

▶DeepSeek4 PAIRINGS

DeepSeek-V3 DeepSeek-V4-Pro DeepSeek-V3.2 DeepSeek-V4-Flash

▶Moonshot4 PAIRINGS

Kimi K2.5 Kimi K2.6 Kimi K3 Kimi K2 Instruct

▶Meta1 PAIRING

▶Z.ai2 PAIRINGS

GLM-5.1 GLM-5.2

▶MiniMax1 PAIRING

▶NVIDIA1 PAIRING

Nemotron 3 Super 120B A12B

Compare Nemotron 3 Ultra 550B A55B withEVERY TRACKED PAIRING

▶Anthropic12 PAIRINGS

Claude Opus 4.8 Claude Opus 4.6 Claude Sonnet 4.5 Claude 3.5 Sonnet Claude Fable 5 Claude Opus 4.5 Claude Opus 5 Claude Opus 4.7 Claude Sonnet 4 Claude Sonnet 4.6 Claude Sonnet 5 Claude Opus 4

▶OpenAI11 PAIRINGS

GPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.2 GPT-5.4 GPT-5 o3 GPT-5.1 o4-mini o1 GPT-4o mini

▶Google11 PAIRINGS

Gemini 3.1 Pro Gemini 3 Pro Gemma 4 26B A4B Gemini 2.5 Pro Gemini 1.5 Pro Gemma 4 31B Gemini 3.5 Flash Gemini 3 Flash Preview Gemini 3.6 Flash Gemma 4 E2B Gemini 2.5 Flash

▶Alibaba11 PAIRINGS

Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3 VL 4B (Reasoning)Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus Qwen3.6 27B Qwen3.6 35B A3B Qwen3.7 Max Qwen3.5 122B A10B Qwen3.7 Plus Preview

▶DeepSeek4 PAIRINGS

DeepSeek-V3 DeepSeek-V4-Pro DeepSeek-V3.2 DeepSeek-V4-Flash

▶Moonshot4 PAIRINGS

Kimi K2.5 Kimi K2.6 Kimi K3 Kimi K2 Instruct

▶Meta1 PAIRING

▶Z.ai2 PAIRINGS

GLM-5.1 GLM-5.2

▶MiniMax1 PAIRING

▶NVIDIA1 PAIRING

Nemotron 3 Super 120B A12B