o3-pro is the stronger all-rounder.GPT-4.1 is cheaper and better at facts.
Scores updated · 9 tests both models report · How we compare
Where each one wins
Tests won in each of the three areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Reasoning, facts and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
GPT-4.1 costs 90% less for the same work.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where o3-pro pulls ahead
- Keeps track of context across a multi-turn chatMulti-Challenge+24.1points ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+17.9points ahead
Where GPT-4.1 pulls ahead
No clear win on a test scored out of 100.
Every test, side by side
All 9 tests both models report. The winning score is in its model's colour; marks a score checked independently.
FactsGPT-4.1
- Vectara HHEM hallucination ratelower is betterGPT-4.1 by 17.75.623.3+17.7
Following instructionso3-pro
- Multi-Challengeo3-pro by 24.138.362.4+24.1
Other results6 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- ARC-AGI-1o3-pro by 53.85.559.3+53.8
- Aider-Polygloto3-pro by 33.351.684.9+33.3
- vectara_factual_consistencyGPT-4.1 by 17.794.476.7+17.7
- AA Intelligenceo3-pro by 9.212.721.9+9.2
- vectara_avg_summary_lengtho3-pro by 35.7 rating points91.7127.4+35.7 rating
- vectara_answer_ratetie99.9100tie
Questions people ask
Which is better, GPT-4.1 or o3-pro?
o3-pro wins two of the three areas where both have results: reasoning and following instructions. GPT-4.1 wins facts, and costs 90% less.
Which is cheaper?
GPT-4.1 costs $2.00 per million input tokens and $8.00 per million output tokens; o3-pro costs $20.00 and $80.00. That makes GPT-4.1 about 90% cheaper for the same work.
How do you compare the two?
We use the 9 benchmark tests both models have published scores on. The verdict counts the 3 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 6 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.