Skip to content
VECTOR WIREAI INTELLIGENCE
⌘K
UTC
Models741Deals30d271Policy30d66, 14 pendingSources1,015

GPT-4.1 vs Qwen3 235B A22B Instruct 2507

OpenAI · released

Wins 1 of 6 areas

Long documents

Alibaba · released

Wins 3 of 6 areas

Coding · Reasoning · Following instructions

Qwen3 235B A22B Instruct 2507 wins more areas, narrowly.GPT-4.1 is better at long documents.

Scores updated · 29 tests both models report · How we compare

Where each one wins

Tests won in each of the six areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

Agents, long documents and following instructions rest on a single test each.

What it costs

Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.

GPT-4.1$2.00 to read · $8.00 to write$10Price from Artificial Analysis
Qwen3 235B A22B Instruct 2507$0.23 to read · $0.92 to write$1.15Price from Alibaba's own price page

Qwen3 235B A22B Instruct 2507 costs 89% less for the same work.

The biggest differences

The three tests each model wins by the widest margin. Scores are out of 100.

Where Qwen3 235B A22B Instruct 2507 pulls ahead

  • Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+16.1points aheadQwen3 235B A22B Instruct 250722.8GPT-4.16.7
  • Graduate-level biology, physics and chemistry questionsGPQA Diamond+8.7points aheadQwen3 235B A22B Instruct 250775.3GPT-4.166.6
  • Recent programming contest problemsLiveCodeBench v6+7.1points aheadQwen3 235B A22B Instruct 250751.8GPT-4.144.7

Where GPT-4.1 pulls ahead

  • Reasons across sets of long documentsAA-LCR+34.4points aheadGPT-4.168.3Qwen3 235B A22B Instruct 250733.9
  • Answers hard knowledge questions correctlyAA-Omniscience · Accuracy+9.1points aheadGPT-4.127.8Qwen3 235B A22B Instruct 250718.7
  • Code for real scientific research problemsSciCode+2.1points aheadGPT-4.138.1Qwen3 235B A22B Instruct 250736

Every test, side by side

All 29 tests both models report. The winning score is in its model's colour; marks a score checked independently.

CodingQwen3 235B A22B Instruct 2507

Full coding ranking

AgentsEven

Full agents ranking

ReasoningQwen3 235B A22B Instruct 2507

Full reasoning ranking

FactsEven

Full facts ranking

Long documentsGPT-4.1
  • AA-LCRGPT-4.1 by 34.468.333.9+34.4

Full long documents ranking

Following instructionsQwen3 235B A22B Instruct 2507
  • IFBenchQwen3 235B A22B Instruct 2507 by 3.14346.1+3.1

Full following instructions ranking

Other results18 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

Questions people ask

Which is better, GPT-4.1 or Qwen3 235B A22B Instruct 2507?

Qwen3 235B A22B Instruct 2507 wins three of the six areas where both have results: coding, reasoning and following instructions. GPT-4.1 wins long documents. They are level on agents and facts.

Which is better for coding?

Qwen3 235B A22B Instruct 2507. It wins 2 of the 3 coding tests both models report; GPT-4.1 wins 1.

Which is cheaper?

GPT-4.1 costs $2.00 per million input tokens and $8.00 per million output tokens; Qwen3 235B A22B Instruct 2507 costs $0.23 and $0.92. That makes Qwen3 235B A22B Instruct 2507 about 89% cheaper for the same work.

How do you compare the two?

We use the 29 benchmark tests both models have published scores on. The verdict counts the 11 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 18 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.