Apriel-v1.6-15B-Thinker vs Claude Haiku 4.5
Wins 2 of 5 areas
Reasoning · Following instructions
Wins 3 of 5 areas
Coding · Facts · Long documents
Claude Haiku 4.5 is the stronger all-rounder.Apriel-v1.6-15B-Thinker is better at reasoning.
Scores updated · 12 tests both models report · How we compare
Where each one wins
Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- CodingWriting and fixing software02Claude Haiku 4.52 of 2 tests
- FactsGetting facts right instead of making them up02Claude Haiku 4.52 of 2 tests
- Long documentsFinding answers in very long texts01Claude Haiku 4.51 of 1 test
- ReasoningHard problems that need careful thinking10Apriel-v1.6-15B-Thinker1 of 3 tests · 2 ties
- Following instructionsDoing exactly what it is asked10Apriel-v1.6-15B-Thinker1 of 1 test
Long documents and following instructions rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Claude Haiku 4.5 pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+64.6points ahead
- Reasons across sets of long documentsAA-LCR+24points ahead
- Hard command-line tasks in a real terminalTerminal-Bench Hard+12.9points ahead
Where Apriel-v1.6-15B-Thinker pulls ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+14.8points ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+6.1points ahead
Every test, side by side
All 12 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingClaude Haiku 4.5
- Terminal-Bench HardClaude Haiku 4.5 by 12.914.427.3+12.9
- SciCodeClaude Haiku 4.5 by 4.937.342.2+4.9
ReasoningApriel-v1.6-15B-Thinker
- GPQA DiamondApriel-v1.6-15B-Thinker by 6.173.367.2+6.1
- Humanity's Last Examtie10.810.4tie
- CritPttie0.30tie
FactsClaude Haiku 4.5
- AA-Omniscience · Non-hallucinationClaude Haiku 4.5 by 64.68.172.7+64.6
- AA-Omniscience · AccuracyClaude Haiku 4.5 by 11718+1
Following instructionsApriel-v1.6-15B-Thinker
- IFBenchApriel-v1.6-15B-Thinker by 14.869.154.3+14.8
Other results3 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- AA-OmniscienceClaude Haiku 4.5 by 55-59.4-4.4+55
- τ²-Bench Telecom (AA run)Apriel-v1.6-15B-Thinker by 14.669.354.7+14.6
- AA IntelligenceClaude Haiku 4.5 by 3.513.416.9+3.5
Questions people ask
Which is better, Apriel-v1.6-15B-Thinker or Claude Haiku 4.5?
Claude Haiku 4.5 wins three of the five areas where both have results: coding, facts and long documents. Apriel-v1.6-15B-Thinker wins reasoning and following instructions.
Which is better for coding?
Claude Haiku 4.5. It wins 2 of the 2 coding tests both models report; Apriel-v1.6-15B-Thinker wins none.
How do you compare the two?
We use the 12 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 3 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.