Gemini 1.5 Pro is the stronger all-rounder.
Scores updated · 14 tests both models report · How we compare
Where each one wins
Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning rests on a single test.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Gemini 1.5 Pro pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+8.9points ahead
Where Nemotron 3 Ultra 550B A55B Base pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 14 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results13 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- OpenBookQAGemini 1.5 Pro by 46.695.248.6+46.6
- MMLUNemotron 3 Ultra 550B A55B Base by 9.679.589.1+9.6
- RULER 1MGemini 1.5 Pro by 8.28576.8+8.2
- RULER 256KGemini 1.5 Pro by 5.491.686.2+5.4
- MMLU-ProNemotron 3 Ultra 550B A55B Base by 3.375.879.1+3.3
- HellaSwagGemini 1.5 Pro by 2.893.390.5+2.8
- GSM8KGemini 1.5 Pro by 2.790.888.1+2.7
- RULER 512KGemini 1.5 Pro by 1.686.184.5+1.6
- RULER 64KNemotron 3 Ultra 550B A55B Base by 1.593.895.3+1.5
- RULER 128Ktie91.792.5tie
- MATHtie82.582tie
- HumanEvaltie84.183.8tie
- MGSMtie87.587.7tie
Questions people ask
Which is better, Gemini 1.5 Pro or Nemotron 3 Ultra 550B A55B Base?
Gemini 1.5 Pro wins the one area where both have results: reasoning. Nemotron 3 Ultra 550B A55B Base wins none.
How do you compare the two?
We use the 14 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 13 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.