Qwen2.5 Instruct 72B is the stronger all-rounder.
Scores updated · 15 tests both models report · How we compare
Where each one wins
Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning rests on a single test.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Qwen2.5 Instruct 72B pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+5.2points ahead
Where Mistral Large 3 675B Base 2512 pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 15 tests both models report. The winning score is in its model's colour; marks a score checked independently.
ReasoningQwen2.5 Instruct 72B
- GPQA DiamondQwen2.5 Instruct 72B by 5.243.949.1+5.2
Other results14 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- OpenBookQAQwen2.5 Instruct 72B by 44.851.496.2+44.8
- MATHQwen2.5 Instruct 72B by 25.562.988.4+25.5
- LiveCodeBenchQwen2.5 Instruct 72B by 21.134.455.5+21.1
- HumanEvalQwen2.5 Instruct 72B by 19.966.786.6+19.9
- SimpleQAMistral Large 3 675B Base 2512 by 14.723.89.1+14.7
- MMMLUMistral Large 3 675B Base 2512 by 10.785.574.8+10.7
- MMLUMistral Large 3 675B Base 2512 by 10.487.377+10.4
- MGSMMistral Large 3 675B Base 2512 by 6.782.976.2+6.7
- GSM8KQwen2.5 Instruct 72B by 4.691.295.8+4.6
- HellaSwagMistral Large 3 675B Base 2512 by 4.188.984.8+4.1
- MMLU-ProQwen2.5 Instruct 72B by 3.767.471.1+3.7
- ARC-ChallengeMistral Large 3 675B Base 2512 by 2.897.394.5+2.8
- PIQAMistral Large 3 675B Base 2512 by 2.284.882.6+2.2
- WinoGrandetie82.182.3tie
Questions people ask
Which is better, Mistral Large 3 675B Base 2512 or Qwen2.5 Instruct 72B?
Qwen2.5 Instruct 72B wins the one area where both have results: reasoning. Mistral Large 3 675B Base 2512 wins none.
How do you compare the two?
We use the 15 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 14 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.