Qwen2 72B is the stronger all-rounder.
Scores updated · 16 tests both models report · How we compare
Where each one wins
Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning rests on a single test.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Qwen2 72B pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+12.2points ahead
Where Gemma (7B) pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 16 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results15 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- C-EvalQwen2 72B by 47.443.691+47.4
- Multi-MathematicsQwen2 72B by 36.939.176+36.9
- GSM8KQwen2 72B by 33.655.989.5+33.6
- MultiPL-EQwen2 72B by 29.929.759.6+29.9
- HumanEvalQwen2 72B by 27.437.264.6+27.4
- BBHQwen2 72B by 27.355.182.4+27.3
- MMLUQwen2 72B by 27.157.184.2+27.1
- MBPPQwen2 72B by 26.350.676.9+26.3
- EvalPlusQwen2 72B by 25.839.665.4+25.8
- MMLU-ProQwen2 72B by 21.933.755.6+21.9
- Theorem QAQwen2 72B by 21.621.543.1+21.6
- TruthfulQAQwen2 72B by 1044.854.8+10
- ARC-ChallengeQwen2 72B by 7.861.168.9+7.8
- HellaSwagQwen2 72B by 5.482.287.6+5.4
- MATHQwen2 72B by 1.15051.1+1.1
Questions people ask
Which is better, Gemma (7B) or Qwen2 72B?
Qwen2 72B wins the one area where both have results: reasoning. Gemma (7B) wins none.
How do you compare the two?
We use the 16 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 15 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.