Nemotron 3 Ultra 550B A55B Base vs NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16
Wins 0 of 1 area
—
Wins 1 of 1 area
Reasoning
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 is the stronger all-rounder.
Scores updated · 14 tests both models report · How we compare
Where each one wins
Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning rests on a single test.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+16.2points ahead
Where Nemotron 3 Ultra 550B A55B Base pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 14 tests both models report. The winning score is in its model's colour; marks a score checked independently.
ReasoningNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16
- GPQA DiamondNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 16.25066.2+16.2
Other results13 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- MBPP-SanitizedNemotron 3 Ultra 550B A55B Base by 6.98679.1+6.9
- MMLUNemotron 3 Ultra 550B A55B Base by 589.184.1+5
- GSM8KNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 3.688.191.7+3.6
- AGIEval-EnNemotron 3 Ultra 550B A55B Base by 378.775.7+3
- MMLU-ProNemotron 3 Ultra 550B A55B Base by 2.879.176.3+2.8
- HumanEvalNemotron 3 Ultra 550B A55B Base by 2.583.881.3+2.5
- HellaSwagNemotron 3 Ultra 550B A55B Base by 1.590.589+1.5
- ARC-ChallengeNemotron 3 Ultra 550B A55B Base by 1.497.396+1.4
- PIQANVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 1.383.885.1+1.3
- RACEtie92.291.4tie
- MGSMtie87.787.5tie
- OpenBookQAtie48.648.8tie
- WinoGrandetie79.379.1tie
Questions people ask
Which is better, Nemotron 3 Ultra 550B A55B Base or NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16?
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 wins the one area where both have results: reasoning. Nemotron 3 Ultra 550B A55B Base wins none.
How do you compare the two?
We use the 14 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 13 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.