VECTOR WIREAI INTELLIGENCE
PKT
Refresh Models Deals Regulatory Sources

Questions this page answers

Which is better, Nemotron 3 Super 120B A12B or NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16?
Across 13 shared benchmarks, Nemotron 3 Super 120B A12B scores higher on 6 and NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 on 6, with 1 level. The widest gap is GPQA Diamond, where Nemotron 3 Super 120B A12B scores 82.7 against 50.

Nemotron 3 Super 120B A12B vs NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16

Across 13 shared benchmarks, Nemotron 3 Super 120B A12B scores higher on 6 and NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 on 6, with 1 level. The widest gap is GPQA Diamond, where Nemotron 3 Super 120B A12B scores 82.7 against 50.

NVIDIAvsNVIDIA13 shared benchmarks66 head-to-head
BenchmarkNemotron 3 Super 120B A12BNVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16
AGIEval-En77.978.7
arc_challenge96.197.3
GPQA Diamond82.750
GSM8K90.788.1
hellaswag8990.5
humaneval80.583.8
mmlu8689.1
MMLU-Pro83.879.1
OpenBookQA48.648.6
RULER 1M93.976.8
RULER 256K96.786.2
RULER 512K95.784.5
winogrande78.979.3

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.