VECTOR WIREAI INTELLIGENCE
⌘K
PKT
Refresh Models —Deals —Regulatory —Sources —

Questions this page answers

Which is better, Nemotron 3 Ultra 550B A55B Base or NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16?
Across 11 shared benchmarks, Nemotron 3 Ultra 550B A55B Base scores higher on 9 and NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 on 2. The widest gap is MMLU-Pro, where Nemotron 3 Ultra 550B A55B Base scores 79.1 against 67.9.

Nemotron 3 Ultra 550B A55B Base vs NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16

Across 11 shared benchmarks, Nemotron 3 Ultra 550B A55B Base scores higher on 9 and NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 on 2. The widest gap is MMLU-Pro, where Nemotron 3 Ultra 550B A55B Base scores 79.1 against 67.9.

NVIDIAvsNVIDIA11 shared benchmarks9–2 head-to-head
BenchmarkNemotron 3 Ultra 550B A55B BaseNVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16
AGIEval-En78.770
arc_challenge97.392.7
GSM8K88.191.3
hellaswag90.585.5
humaneval83.877.4
mmlu89.178.6
MMLU-Pro79.167.9
OpenBookQA48.647.6
RULER 1M76.869.6
RULER 256K86.276.9
winogrande79.380

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.