Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

GPT-6 Astra vs GPT-6 Sol

32 SHARED BENCHMARKS

Across 32 shared benchmarks, GPT-6 Astra scores higher on 25 and GPT-6 Sol on 6, with 1 level. The widest gap is vectara_avg_summary_length, where GPT-6 Astra scores 148.5 against 71.4. GPT-6 Sol is the cheaper of the two on tracked API pricing ($2.00 against $10.00 per million input tokens).

OPENAIVSOPENAI32 SHARED25–6 HEAD-TO-HEADNEWEST SCORE ADDED

At a glance

MakerOpenAIOpenAI
Released
Price per 1M tokens input / output$10.00 / $50.00$2.00 / $10.00
Cost of 1M in + 1M out$60.00$12.00 5.0× less
Head-to-head of 32 shared benchmarks25 wins6 wins
Scores tracked independently verified160 43 ◆107 37 ◆

Release dates per Artificial Analysis. Prices: Artificial Analysis for GPT-6 Astra; Artificial Analysis for GPT-6 Sol. ◆ = independently verified score.

Where each leadsby capability area · benchmark wins

AreaGPT-6 AstraWINSGPT-6 Sol
Reasoning60GPT-6 Astra leads 6 of 6 · widest: SimpleBench 83.6 vs 73.1
Coding22Even, 2–2 of 4
Agentic21GPT-6 Astra leads 2 of 3 · widest: Terminal-Bench 4.0 59.1 vs 43.9
Factuality21GPT-6 Astra leads 2 of 3 · widest: AA-Omniscience · Non-hallucination 48.7 vs 39.9
Instruction Following10GPT-6 Astra leads 1 of 1 · widest: LiveBench · Instruction Following 75.6 vs 68.6
Long Context01GPT-6 Sol leads 1 of 1 · widest: AA-LCR 80.7 vs 83.7
Math10GPT-6 Astra leads 1 of 1
Multimodal10GPT-6 Astra leads 1 of 1 · widest: MMMU-Pro 86.9 vs 83.3

Biggest gaps

GPT-6 Astra pulls furthest ahead on

  1. Terminal-Bench 4.059.1 vs 43.9
  2. AA-Omniscience · Non-hallucination48.7 vs 39.9
  3. AA-Omniscience · Accuracy62.6 vs 54.5

GPT-6 Sol pulls furthest ahead on

  1. AA-LCR83.7 vs 80.7

Every shared benchmark32 · grouped by area

Reasoning 6

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
ARC-AGI-399.9◆ 4.6
ARC-AGI-295◆ 89.6
CritPt31.730.9
LiveBench · Reasoning92.7 ◆◆ 88.7
SimpleBench83.6 ◆◆ 73.1

Coding 4

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
LMArena · WebDev1792 ◆◆ 1681
LiveBench · Coding80.4 ◆◆ 81.8
SciCode56.557.6

Agentic 3

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
GDPVal52.149.3
Terminal-Bench 4.059.143.9

Factuality 3

Instruction Following 1

Long Context 1

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
AA-LCR80.783.7

Math 1

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
LiveBench · Mathematics96.8 ◆◆ 96.4

Multimodal 1

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
MMMU-Pro86.983.3

Other shared benchmarks 12

BenchmarkGPT-6 AstraMARGINGPT-6 Sol
ARC-AGI-197.5 ◆◆ 95.5
DeepSWE 1.174.168.8
GDPval-AA 2.115421487
livebench_language89.4 ◆◆ 85.3
OSWorld 2.072.664.4
vectara_answer_rate100 ◆◆ 100

Each score is the one the model's own page shows — the most authoritative tracked result for that benchmark, on the benchmark's standard methodology (source-attributed). ↓ marks lower-is-better metrics; ◆ an independently verified score. Open either model for its full surface, provenance and pricing. Quoted rates are the price-setter row we currently track for each model — its direct or vendor-official listing where one exists (direct, direct), otherwise the lowest tracked offer.

Compare GPT-6 Astra withALL PAIRINGS →