Gemma 4 31B vs Qwen3.8 Max Preview
Wins 0 of 7 areas
—
Wins 7 of 7 areas
Coding · Agents · Reasoning · Facts · Images and charts · Long documents · Following instructions
Qwen3.8 Max Preview is the stronger all-rounder.Gemma 4 31B is cheaper.
Scores updated · 32 tests both models report · How we compare
Where each one wins
Tests won in each of the seven areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- CodingWriting and fixing software04Qwen3.8 Max Preview4 of 4 tests
- AgentsCarrying out multi-step tasks on its own04Qwen3.8 Max Preview4 of 4 tests
- ReasoningHard problems that need careful thinking03Qwen3.8 Max Preview3 of 3 tests
- FactsGetting facts right instead of making them up03Qwen3.8 Max Preview3 of 3 tests
- Images and chartsUnderstanding pictures, charts and video02Qwen3.8 Max Preview2 of 2 tests
- Long documentsFinding answers in very long texts02Qwen3.8 Max Preview2 of 2 tests
- Following instructionsDoing exactly what it is asked01Qwen3.8 Max Preview1 of 1 test
Following instructions rests on a single test.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
Gemma 4 31B costs 93% less for the same work.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Qwen3.8 Max Preview pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+56.2points ahead
- Real work tasks from 44 professionsGDPVal+52.3points ahead
- Command-line tasks in a real terminalTerminal-Bench 2.1+45.4points ahead
Where Gemma 4 31B pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 32 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingQwen3.8 Max Preview
- Terminal-Bench 2.1Qwen3.8 Max Preview by 45.443.488.8+45.4
- SWE-bench ProQwen3.8 Max Preview by 3235.767.7+32
- LMArena · WebDevQwen3.8 Max Preview by 305 rating points13651670+305 rating
- SciCodeQwen3.8 Max Preview by 6.645.552.1+6.6
AgentsQwen3.8 Max Preview
- GDPValQwen3.8 Max Preview by 52.3658.3+52.3
- Terminal-Bench 4.0Qwen3.8 Max Preview by 38.9038.9+38.9
- τ-Bench V3 · BankingQwen3.8 Max Preview by 3314.847.8+33
- AA IT-Bench SREQwen3.8 Max Preview by 337.340.3+3
ReasoningQwen3.8 Max Preview
- Humanity's Last ExamQwen3.8 Max Preview by 19.523.643.1+19.5
- CritPtQwen3.8 Max Preview by 16.31.417.7+16.3
- GPQA DiamondQwen3.8 Max Preview by 7.185.792.8+7.1
FactsQwen3.8 Max Preview
- AA-Omniscience · Non-hallucinationQwen3.8 Max Preview by 56.21571.2+56.2
- SimpleQA VerifiedQwen3.8 Max Preview by 36.910.447.3+36.9
- AA-Omniscience · AccuracyQwen3.8 Max Preview by 11.72031.7+11.7
Images and chartsQwen3.8 Max Preview
- MMMU-ProQwen3.8 Max Preview by 9.473.482.8+9.4
- LMArena · VisionQwen3.8 Max Preview by 28 rating points12791307+28 rating
Long documentsQwen3.8 Max Preview
- LongBench v2Qwen3.8 Max Preview by 13.452.966.3+13.4
- AA-LCRQwen3.8 Max Preview by 10.669.780.3+10.6
Following instructionsQwen3.8 Max Preview
- IFBenchQwen3.8 Max Preview by 7.275.682.8+7.2
Other results13 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- AA-OmniscienceQwen3.8 Max Preview by 59.9-47.912+59.9
- WideSearchQwen3.8 Max Preview by 46.735.281.9+46.7
- JobBenchQwen3.8 Max Preview by 45.28.253.4+45.2
- AA Agentic IndexQwen3.8 Max Preview by 42.96.749.6+42.9
- NL2RepoQwen3.8 Max Preview by 40.415.555.9+40.4
- AA IntelligenceQwen3.8 Max Preview by 30.714.745.4+30.7
- HLE (with tools)Qwen3.8 Max Preview by 29.726.556.2+29.7
- Artificial Analysis Coding IndexQwen3.8 Max Preview by 28.443.471.8+28.4
- CritPt v2 HardQwen3.8 Max Preview by 25.5429.5+25.5
- GDP (Surge AI)Qwen3.8 Max Preview by 16.8622.8+16.8
- HLE-DiamondQwen3.8 Max Preview by 16.87.224+16.8
- RealWorldQAQwen3.8 Max Preview by 15.772.388+15.7
- Terminal-Bench-Science 0.1Qwen3.8 Max Preview by 11.9011.9+11.9
Questions people ask
Which is better, Gemma 4 31B or Qwen3.8 Max Preview?
Qwen3.8 Max Preview wins all seven areas where both have results: coding, agents, reasoning, facts, images and charts, long documents and following instructions. Gemma 4 31B wins none, but costs 93% less.
Which is better for coding?
Qwen3.8 Max Preview. It wins 4 of the 4 coding tests both models report; Gemma 4 31B wins none.
Which is cheaper?
Gemma 4 31B costs $0.15 per million input tokens and $0.40 per million output tokens; Qwen3.8 Max Preview costs $2.00 and $6.00. That makes Gemma 4 31B about 93% cheaper for the same work.
How do you compare the two?
We use the 32 benchmark tests both models have published scores on. The verdict counts the 19 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 13 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.