GPT-5.6 Sol vs Qwen3.7 Max
Wins 6 of 7 areas
Coding · Agents · Reasoning · Facts · Math · Long documents
Wins 1 of 7 areas
Following instructions
GPT-5.6 Sol is the stronger all-rounder.Qwen3.7 Max is cheaper and better at following instructions.
Scores updated · 45 tests both models report · How we compare
Where each one wins
Tests won in each of the seven areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- CodingWriting and fixing software70GPT-5.6 Sol7 of 7 tests
- AgentsCarrying out multi-step tasks on its own50GPT-5.6 Sol5 of 5 tests
- MathCompetition and research-level math40GPT-5.6 Sol4 of 4 tests
- ReasoningHard problems that need careful thinking41GPT-5.6 Sol4 of 5 tests
- FactsGetting facts right instead of making them up21GPT-5.6 Sol2 of 3 tests
- Long documentsFinding answers in very long texts10GPT-5.6 Sol1 of 1 test
- Following instructionsDoing exactly what it is asked02Qwen3.7 Max2 of 2 tests
Long documents rests on a single test.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
Qwen3.7 Max costs 58% less for the same work.
The biggest differences
The three tests each model wins by the widest margin. Scores are out of 100.
Where GPT-5.6 Sol pulls ahead
- Extremely hard research-level math problemsFrontierMath Tier 4+48.8points ahead
- Complex command-line tasks across many fieldsTerminal-Bench 4.0+38.4points ahead
- Customer-service tasks in a simulated bankτ-Bench V3 · Banking+32.5points ahead
Where Qwen3.7 Max pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+66.6points ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+7.8points ahead
- Common-sense trick questionsSimpleBench+5.6points ahead
Every test, side by side
All 45 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingGPT-5.6 Sol
- Terminal-Bench HardGPT-5.6 Sol by 15.165.950.8+15.1
- Terminal-Bench 2.1GPT-5.6 Sol by 13.58874.5+13.5
- LiveBench · Agentic CodingGPT-5.6 Sol by 12.656.243.6+12.6
- LMArena · WebDevGPT-5.6 Sol by 103 rating points16181515+103 rating
- LiveBench · CodingGPT-5.6 Sol by 9.783.974.2+9.7
- SciCodeGPT-5.6 Sol by 7.657.149.5+7.6
- SWE-bench ProGPT-5.6 Sol by 464.660.6+4
AgentsGPT-5.6 Sol
- Terminal-Bench 4.0GPT-5.6 Sol by 38.439.91.5+38.4
- τ-Bench V3 · BankingGPT-5.6 Sol by 32.544.311.8+32.5
- GDPValGPT-5.6 Sol by 2455.631.6+24
- AA IT-Bench SREGPT-5.6 Sol by 13.756.242.5+13.7
- MCP AtlasGPT-5.6 Sol by 7.283.676.4+7.2
ReasoningGPT-5.6 Sol
- CritPtGPT-5.6 Sol by 18.932.313.4+18.9
- Humanity's Last ExamGPT-5.6 Sol by 949.540.5+9
- LiveBench · ReasoningGPT-5.6 Sol by 8.491.783.3+8.4
- SimpleBenchQwen3.7 Max by 5.664.870.4+5.6
- GPQA DiamondGPT-5.6 Sol by 1.894.192.3+1.8
FactsGPT-5.6 Sol
- AA-Omniscience · Non-hallucinationQwen3.7 Max by 66.67.874.4+66.6
- AA-Omniscience · AccuracyGPT-5.6 Sol by 28.359.431.1+28.3
- SimpleQA VerifiedGPT-5.6 Sol by 13.969.755.8+13.9
MathGPT-5.6 Sol
- FrontierMath Tier 4GPT-5.6 Sol by 48.88334.1+48.8
- FrontierMath Tiers 1-3 (v2)GPT-5.6 Sol by 24.589.164.6+24.5
- LiveBench · MathematicsGPT-5.6 Sol by 10.996.285.3+10.9
- AIME 2026GPT-5.6 Sol by 2.999.997+2.9
Following instructionsQwen3.7 Max
- IFBenchQwen3.7 Max by 7.872.780.5+7.8
- LiveBench · Instruction FollowingQwen3.7 Max by 2.171.874+2.1
Other results18 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- DeepSWEGPT-5.6 Sol by 54.772.718+54.7
- DeepSWE 1.1GPT-5.6 Sol by 51.47321.6+51.4
- AA Agentic IndexGPT-5.6 Sol by 26.650.523.9+26.6
- PaperBenchGPT-5.6 Sol by 25.790.564.8+25.7
- Toolathlon VerifiedGPT-5.6 Sol by 25.274.949.7+25.2
- Agents' Last Exam (Pass / Score)GPT-5.6 Sol by 22.553.631.1+22.5
- MathArena Apex (Pass@1)GPT-5.6 Sol by 21.165.644.5+21.1
- AA IntelligenceGPT-5.6 Sol by 17.54729.5+17.5
- AndroidBenchGPT-5.6 Sol by 17.57456.5+17.5
- MLS Bench Litelower is betterQwen3.7 Max by 14.546.231.7+14.5
- JobBenchGPT-5.6 Sol by 14.145.431.3+14.1
- Artificial Analysis Coding IndexGPT-5.6 Sol by 11.477.466+11.4
- HLE (with tools)GPT-5.6 Sol by 1164.553.5+11
- τ²-Bench Telecom (AA run)Qwen3.7 Max by 9.685.194.7+9.6
- AA-OmniscienceGPT-5.6 Sol by 8.52213.5+8.5
- livebench_data_analysisGPT-5.6 Sol by 879.871.8+8
- livebench_languageGPT-5.6 Sol by 887.779.7+8
- HealthBenchGPT-5.6 Sol by 2.55754.5+2.5
Questions people ask
Which is better, GPT-5.6 Sol or Qwen3.7 Max?
GPT-5.6 Sol wins six of the seven areas where both have results: coding, agents, reasoning, facts, math and long documents. Qwen3.7 Max wins following instructions, and costs 58% less.
Which is better for coding?
GPT-5.6 Sol. It wins 7 of the 7 coding tests both models report; Qwen3.7 Max wins none.
Which is cheaper?
GPT-5.6 Sol costs $4.00 per million input tokens and $20.00 per million output tokens; Qwen3.7 Max costs $2.50 and $7.50. That makes Qwen3.7 Max about 58% cheaper for the same work.
How do you compare the two?
We use the 45 benchmark tests both models have published scores on. The verdict counts the 27 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 18 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.