DeepSeek-R1 0528-Qwen3-8B vs Gemini 2.5 Pro
Wins 0 of 5 areas
—
Wins 4 of 5 areas
Coding · Reasoning · Long documents · Following instructions
Gemini 2.5 Pro is the stronger all-rounder.
Scores updated · 17 tests both models report · How we compare
Where each one wins
Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- ReasoningHard problems that need careful thinking03Gemini 2.5 Pro3 of 3 tests
- CodingWriting and fixing software02Gemini 2.5 Pro2 of 2 tests
- Long documentsFinding answers in very long texts01Gemini 2.5 Pro1 of 1 test
- Following instructionsDoing exactly what it is asked01Gemini 2.5 Pro1 of 1 test
- FactsGetting facts right instead of making them up11Even1 each
Long documents and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Gemini 2.5 Pro pulls ahead
- Reasons across sets of long documentsAA-LCR+54points ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+28.8points ahead
- Answers hard knowledge questions correctlyAA-Omniscience · Accuracy+26.9points ahead
Where DeepSeek-R1 0528-Qwen3-8B pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+4.5points ahead
Every test, side by side
All 17 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingGemini 2.5 Pro
- SciCodeGemini 2.5 Pro by 25.920.446.3+25.9
- Terminal-Bench HardGemini 2.5 Pro by 251.526.5+25
ReasoningGemini 2.5 Pro
- GPQA DiamondGemini 2.5 Pro by 22.461.283.6+22.4
- Humanity's Last ExamGemini 2.5 Pro by 12.15.918+12.1
- CritPtGemini 2.5 Pro by 2.602.6+2.6
FactsEven
- AA-Omniscience · AccuracyGemini 2.5 Pro by 26.912.239+26.9
- AA-Omniscience · Non-hallucinationDeepSeek-R1 0528-Qwen3-8B by 4.513.69.1+4.5
Following instructionsGemini 2.5 Pro
- IFBenchGemini 2.5 Pro by 28.819.948.7+28.8
Other results8 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- τ²-Bench Telecom (AA run)Gemini 2.5 Pro by 54.1054.1+54.1
- AA-OmniscienceGemini 2.5 Pro by 47.3-63.6-16.4+47.3
- Artificial Analysis Coding IndexGemini 2.5 Pro by 38.97.846.7+38.9
- HMMT Feb. 2025Gemini 2.5 Pro by 19.361.580.8+19.3
- LiveCodeBenchGemini 2.5 Pro by 13.760.574.2+13.7
- AA IntelligenceGemini 2.5 Pro by 6.98.115+6.9
- AIME 2025Gemini 2.5 Pro by 6.776.383+6.7
- AIME 2024Gemini 2.5 Pro by 68692+6
Questions people ask
Which is better, DeepSeek-R1 0528-Qwen3-8B or Gemini 2.5 Pro?
Gemini 2.5 Pro wins four of the five areas where both have results: coding, reasoning, long documents and following instructions. DeepSeek-R1 0528-Qwen3-8B wins none. They are level on facts.
Which is better for coding?
Gemini 2.5 Pro. It wins 2 of the 2 coding tests both models report; DeepSeek-R1 0528-Qwen3-8B wins none.
How do you compare the two?
We use the 17 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 8 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.