DeepSeek-R1-Distill-Llama-70B vs o3
Wins 0 of 5 areas
—
Wins 4 of 5 areas
Coding · Reasoning · Long documents · Following instructions
o3 is the stronger all-rounder.DeepSeek-R1-Distill-Llama-70B is cheaper.
Scores updated · 18 tests both models report · How we compare
Where each one wins
Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- ReasoningHard problems that need careful thinking03o33 of 3 tests
- CodingWriting and fixing software02o32 of 2 tests
- Long documentsFinding answers in very long texts01o31 of 1 test
- Following instructionsDoing exactly what it is asked01o31 of 1 test
- FactsGetting facts right instead of making them up11Even1 each
Long documents and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
DeepSeek-R1-Distill-Llama-70B costs 82% less for the same work.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where o3 pulls ahead
- Reasons across sets of long documentsAA-LCR+64.7points ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+43.8points ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+42.5points ahead
Where DeepSeek-R1-Distill-Llama-70B pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+7points ahead
Every test, side by side
All 18 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Reasoningo3
- GPQA Diamondo3 by 42.540.282.7+42.5
- Humanity's Last Examo3 by 155.120.1+15
- CritPto3 by 1.101.1+1.1
FactsEven
- AA-Omniscience · Accuracyo3 by 19.419.238.6+19.4
- AA-Omniscience · Non-hallucinationDeepSeek-R1-Distill-Llama-70B by 718.911.9+7
Other results9 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- τ²-Bench Telecom (AA run)o3 by 58.821.980.7+58.8
- HMMT Feb. 2025o3 by 44.233.377.5+44.2
- AIME 2025o3 by 31.45586.4+31.4
- AA-Omniscienceo3 by 30.9-46.4-15.6+30.9
- LiveCodeBencho3 by 27.257.584.7+27.2
- Artificial Analysis Coding Indexo3 by 2711.438.4+27
- AIME 2024o3 by 21.67091.6+21.6
- AA Intelligenceo3 by 12.37.920.2+12.3
- MATH-500 (EM)o3 by 3.694.598.1+3.6
Questions people ask
Which is better, DeepSeek-R1-Distill-Llama-70B or o3?
o3 wins four of the five areas where both have results: coding, reasoning, long documents and following instructions. DeepSeek-R1-Distill-Llama-70B wins none, but costs 82% less. They are level on facts.
Which is better for coding?
o3. It wins 2 of the 2 coding tests both models report; DeepSeek-R1-Distill-Llama-70B wins none.
Which is cheaper?
DeepSeek-R1-Distill-Llama-70B costs $0.70 per million input tokens and $1.10 per million output tokens; o3 costs $2.00 and $8.00. That makes DeepSeek-R1-Distill-Llama-70B about 82% cheaper for the same work.
How do you compare the two?
We use the 18 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 9 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.