Llama 3 (70B) is the stronger all-rounder.
Scores updated · 16 tests both models report · How we compare
Where each one wins
Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning rests on a single test.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Llama 3 (70B) pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+1points ahead
Where DeepSeek-V2 pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 16 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results15 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- ARC-ChallengeDeepSeek-V2 by 23.492.268.8+23.4
- MATHLlama 3 (70B) by 22.943.466.3+22.9
- CMMLUDeepSeek-V2 by 16.88467.2+16.8
- C-EvalDeepSeek-V2 by 16.281.465.2+16.2
- Multi-MathematicsLlama 3 (70B) by 8.358.867.1+8.3
- MMLUDeepSeek-V2 by 6.175.669.5+6.1
- MBPPLlama 3 (70B) by 5.46570.4+5.4
- HumanEvalLlama 3 (70B) by 4.943.348.2+4.9
- TruthfulQALlama 3 (70B) by 3.442.245.6+3.4
- BBHLlama 3 (70B) by 2.278.881+2.2
- MultiPL-ELlama 3 (70B) by 1.944.446.3+1.9
- MMLU-ProLlama 3 (70B) by 1.451.452.8+1.4
- GSM8KLlama 3 (70B) by 1.379.280.5+1.3
- HellaSwagtie87.188tie
- EvalPlustie5554.8tie
Questions people ask
Which is better, DeepSeek-V2 or Llama 3 (70B)?
Llama 3 (70B) wins the one area where both have results: reasoning. DeepSeek-V2 wins none.
How do you compare the two?
We use the 16 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 15 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.