Scores updated · 6 tests both models report · How we compare
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
Claude 3.5 Sonnet$3.00 to read · $15.00 to writePrice from Artificial Analysis
Qwen Long$0.07 to read · $0.29 to writePrice from Alibaba's own price page
Qwen Long costs 98% less for the same work.
Every test, side by side
All 6 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results6 tests
- MTOB kalam → eng (BLEURT) full bookClaude 3.5 Sonnet by 30.162.332.1+30.1
- MTOB eng → kalam (ChrF) full bookClaude 3.5 Sonnet by 9.855.645.9+9.8
- MTOB kalam → eng (BLEURT) half bookClaude 3.5 Sonnet by 6.659.753.1+6.6
- MTOB eng → kalam (ChrF) half bookClaude 3.5 Sonnet by 5.153.648.5+5.1
- MTOB eng → kalam (ChrF) no contextClaude 3.5 Sonnet by 3.620.216.6+3.6
- MTOB kalam → eng (BLEURT) no contextClaude 3.5 Sonnet by 1.331.430.1+1.3
Questions people ask
Which is cheaper?
Claude 3.5 Sonnet costs $3.00 per million input tokens and $15.00 per million output tokens; Qwen Long costs $0.07 and $0.29. That makes Qwen Long about 98% cheaper for the same work.
How do you compare the two?
We use the 6 benchmark tests both models have published scores on. None of them is in the eight capability areas we count, so this page lists them without a verdict. Each score is the one shown on the model's own page.