Gemma 4 31B vs Nemotron 3 Ultra 550B A55B
Wins 0 of 7 areas
—
Wins 7 of 7 areas
Coding · Agents · Reasoning · Facts · Math · Long documents · Following instructions
Nemotron 3 Ultra 550B A55B is the stronger all-rounder.Gemma 4 31B is cheaper.
Scores updated · 35 tests both models report · How we compare
Where each one wins
Tests won in each of the seven areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- CodingWriting and fixing software15Nemotron 3 Ultra 550B A55B5 of 7 tests · 1 tie
- ReasoningHard problems that need careful thinking03Nemotron 3 Ultra 550B A55B3 of 3 tests
- FactsGetting facts right instead of making them up03Nemotron 3 Ultra 550B A55B3 of 3 tests
- MathCompetition and research-level math03Nemotron 3 Ultra 550B A55B3 of 3 tests
- Long documentsFinding answers in very long texts02Nemotron 3 Ultra 550B A55B2 of 2 tests
- AgentsCarrying out multi-step tasks on its own12Nemotron 3 Ultra 550B A55B2 of 5 tests · 2 ties
- Following instructionsDoing exactly what it is asked01Nemotron 3 Ultra 550B A55B1 of 1 test
Following instructions rests on a single test.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
Gemma 4 31B costs 81% less for the same work.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Nemotron 3 Ultra 550B A55B pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+55.3points ahead
- Fixes real GitHub issues in many programming languagesSWE-bench Multilingual+24.7points ahead
- Fixes real GitHub issues in Python projectsSWE-bench Verified+24.6points ahead
Every test, side by side
All 35 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingNemotron 3 Ultra 550B A55B
- SWE-bench MultilingualNemotron 3 Ultra 550B A55B by 24.74367.7+24.7
- SWE-bench VerifiedNemotron 3 Ultra 550B A55B by 24.646.170.7+24.6
- SWE-bench ProNemotron 3 Ultra 550B A55B by 1435.749.7+14
- Terminal-Bench 2.1Nemotron 3 Ultra 550B A55B by 10.543.453.9+10.5
- LiveCodeBench v6Nemotron 3 Ultra 550B A55B by 98089+9
- SciCodeGemma 4 31B by 5.245.540.3+5.2
- Terminal-Bench Hardtie36.436.4tie
AgentsNemotron 3 Ultra 550B A55B
- GDPValNemotron 3 Ultra 550B A55B by 19.7625.7+19.7
- MCP AtlasGemma 4 31B by 9.554.244.7+9.5
- BrowseCompNemotron 3 Ultra 550B A55B by 7.43744.4+7.4
- τ-Bench V3 · Bankingtie14.814.2tie
- Terminal-Bench 4.0tie00.5tie
ReasoningNemotron 3 Ultra 550B A55B
- Humanity's Last ExamNemotron 3 Ultra 550B A55B by 4.823.628.4+4.8
- CritPtNemotron 3 Ultra 550B A55B by 1.71.43.1+1.7
- GPQA DiamondNemotron 3 Ultra 550B A55B by 185.786.7+1
FactsNemotron 3 Ultra 550B A55B
- AA-Omniscience · Non-hallucinationNemotron 3 Ultra 550B A55B by 55.31570.3+55.3
- SimpleQA VerifiedNemotron 3 Ultra 550B A55B by 2210.432.4+22
- AA-Omniscience · AccuracyNemotron 3 Ultra 550B A55B by 2.62022.6+2.6
MathNemotron 3 Ultra 550B A55B
- IMOAnswerBenchNemotron 3 Ultra 550B A55B by 17.874.592.3+17.8
- AIME 2026Nemotron 3 Ultra 550B A55B by 589.294.2+5
- HMMT Feb. 2026Nemotron 3 Ultra 550B A55B by 1.677.278.8+1.6
Long documentsNemotron 3 Ultra 550B A55B
- AA-LCRNemotron 3 Ultra 550B A55B by 9.669.779.3+9.6
- LongBench v2Nemotron 3 Ultra 550B A55B by 952.961.9+9
Following instructionsNemotron 3 Ultra 550B A55B
- IFBenchNemotron 3 Ultra 550B A55B by 5.875.681.4+5.8
Other results11 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- AA-OmniscienceNemotron 3 Ultra 550B A55B by 47.5-47.9-0.4+47.5
- τ²-Bench Telecom (AA run)Nemotron 3 Ultra 550B A55B by 23.459.983.3+23.4
- AA Agentic IndexNemotron 3 Ultra 550B A55B by 156.721.7+15
- CritPt v2 HardNemotron 3 Ultra 550B A55B by 11415+11
- HLE (with tools)Nemotron 3 Ultra 550B A55B by 10.926.537.4+10.9
- AA IntelligenceNemotron 3 Ultra 550B A55B by 8.214.722.9+8.2
- Artificial Analysis Coding IndexNemotron 3 Ultra 550B A55B by 5.943.449.3+5.9
- MMLU-ProNemotron 3 Ultra 550B A55B by 1.685.286.8+1.6
- HLE-DiamondNemotron 3 Ultra 550B A55B by 1.37.28.5+1.3
- GDP (Surge AI)Gemma 4 31B by 165+1
- Terminal-Bench-Science 0.1tie00tie
Questions people ask
Which is better, Gemma 4 31B or Nemotron 3 Ultra 550B A55B?
Nemotron 3 Ultra 550B A55B wins all seven areas where both have results: coding, agents, reasoning, facts, math, long documents and following instructions. Gemma 4 31B wins none, but costs 81% less.
Which is better for coding?
Nemotron 3 Ultra 550B A55B. It wins 5 of the 7 coding tests both models report; Gemma 4 31B wins 1, and 1 is a tie.
Which is cheaper?
Gemma 4 31B costs $0.15 per million input tokens and $0.40 per million output tokens; Nemotron 3 Ultra 550B A55B costs $0.55 and $2.30. That makes Gemma 4 31B about 81% cheaper for the same work.
How do you compare the two?
We use the 35 benchmark tests both models have published scores on. The verdict counts the 24 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 11 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.