Gemma 3n E2B Instruct vs Qwen2.5 Instruct 72B
Wins 0 of 5 areas
—
Wins 5 of 5 areas
Coding · Reasoning · Facts · Long documents · Following instructions
Qwen2.5 Instruct 72B is the stronger all-rounder.
Scores updated · 20 tests both models report · How we compare
Where each one wins
Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- CodingWriting and fixing software02Qwen2.5 Instruct 72B2 of 2 tests
- FactsGetting facts right instead of making them up02Qwen2.5 Instruct 72B2 of 2 tests
- ReasoningHard problems that need careful thinking01Qwen2.5 Instruct 72B1 of 3 tests · 2 ties
- Long documentsFinding answers in very long texts01Qwen2.5 Instruct 72B1 of 1 test
- Following instructionsDoing exactly what it is asked01Qwen2.5 Instruct 72B1 of 1 test
Long documents and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Qwen2.5 Instruct 72B pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+26.2points ahead
- Code for real scientific research problemsSciCode+21.5points ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+14.9points ahead
Where Gemma 3n E2B Instruct pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 20 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingQwen2.5 Instruct 72B
- SciCodeQwen2.5 Instruct 72B by 21.55.226.7+21.5
- Terminal-Bench HardQwen2.5 Instruct 72B by 3.70.84.5+3.7
ReasoningQwen2.5 Instruct 72B
- GPQA DiamondQwen2.5 Instruct 72B by 26.222.949.1+26.2
- Humanity's Last Examtie4.23.6tie
- CritPttie00tie
FactsQwen2.5 Instruct 72B
- AA-Omniscience · AccuracyQwen2.5 Instruct 72B by 10.76.817.5+10.7
- AA-Omniscience · Non-hallucinationQwen2.5 Instruct 72B by 7.96.614.5+7.9
Following instructionsQwen2.5 Instruct 72B
- IFBenchQwen2.5 Instruct 72B by 14.92236.9+14.9
Other results11 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- ARC-ChallengeQwen2.5 Instruct 72B by 42.851.794.5+42.8
- BBHQwen2.5 Instruct 72B by 35.544.379.8+35.5
- τ²-Bench Telecom (AA run)Qwen2.5 Instruct 72B by 34.5034.5+34.5
- AA-OmniscienceQwen2.5 Instruct 72B by 27.1-80.2-53.1+27.1
- DROPQwen2.5 Instruct 72B by 22.853.976.7+22.8
- NaturalQuestionsQwen2.5 Instruct 72B by 17.715.533.2+17.7
- WinoGrandeQwen2.5 Instruct 72B by 15.566.882.3+15.5
- HellaSwagQwen2.5 Instruct 72B by 12.672.284.8+12.6
- Artificial Analysis Coding IndexQwen2.5 Instruct 72B by 9.72.211.9+9.7
- PIQAQwen2.5 Instruct 72B by 3.778.982.6+3.7
- AA IntelligenceQwen2.5 Instruct 72B by 2.94.87.7+2.9
Questions people ask
Which is better, Gemma 3n E2B Instruct or Qwen2.5 Instruct 72B?
Qwen2.5 Instruct 72B wins all five areas where both have results: coding, reasoning, facts, long documents and following instructions. Gemma 3n E2B Instruct wins none.
Which is better for coding?
Qwen2.5 Instruct 72B. It wins 2 of the 2 coding tests both models report; Gemma 3n E2B Instruct wins none.
How do you compare the two?
We use the 20 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 11 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.