The two are evenly matched.Claude Opus 4 is better at facts; o3-pro at following instructions.
Scores updated · 10 tests both models report · How we compare
Where each one wins
Tests won in each of the three areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Facts and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
Claude Opus 4 costs 10% less for the same work.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Claude Opus 4 pulls ahead
- Abstract visual puzzles that people can solveARC-AGI-2+3.7points ahead
Where o3-pro pulls ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+4.9points ahead
- Keeps track of context across a multi-turn chatMulti-Challenge+3.8points ahead
Every test, side by side
All 10 tests both models report. The winning score is in its model's colour; marks a score checked independently.
ReasoningEven
- GPQA Diamondo3-pro by 4.979.684.5+4.9
- ARC-AGI-2Claude Opus 4 by 3.78.64.9+3.7
FactsClaude Opus 4
- Vectara HHEM hallucination ratelower is betterClaude Opus 4 by 11.31223.3+11.3
Following instructionso3-pro
- Multi-Challengeo3-pro by 3.858.662.4+3.8
Other results6 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- ARC-AGI-1o3-pro by 23.635.759.3+23.6
- Aider-Polygloto3-pro by 14.270.784.9+14.2
- vectara_factual_consistencyClaude Opus 4 by 11.38876.7+11.3
- vectara_answer_rateo3-pro by 991100+9
- AA Intelligenceo3-pro by 1.320.621.9+1.3
- vectara_avg_summary_lengthtie123.2127.4tie
Questions people ask
Which is better, Claude Opus 4 or o3-pro?
Claude Opus 4 and o3-pro each win one of the three areas where both have results. Claude Opus 4 wins facts; o3-pro wins following instructions. Claude Opus 4 costs 10% less. They are level on reasoning.
Which is cheaper?
Claude Opus 4 costs $15.00 per million input tokens and $75.00 per million output tokens; o3-pro costs $20.00 and $80.00. That makes Claude Opus 4 about 10% cheaper for the same work.
How do you compare the two?
We use the 10 benchmark tests both models have published scores on. The verdict counts the 4 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 6 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.