Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

Claude 3 Haiku vs Reka Flash 3

Anthropic · released

Wins 3 of 5 areas

Facts · Long documents · Following instructions

Reka · released

Wins 2 of 5 areas

Coding · Reasoning

Claude 3 Haiku is the stronger all-rounder.Reka Flash 3 is cheaper and better at reasoning.

Scores updated · 14 tests both models report · How we compare

Where each one wins

Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

Long documents and following instructions rest on a single test each.

What it costs

Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.

Claude 3 Haiku$0.25 to read · $1.25 to write$1.50Price from Artificial Analysis
Reka Flash 3$0.20 to read · $0.80 to write$1.00Price from Artificial Analysis

Reka Flash 3 costs 33% less for the same work.

The biggest differences

The tests each model wins by the widest margin, up to three each. Scores are out of 100.

Where Claude 3 Haiku pulls ahead

  • Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+10.8points aheadClaude 3 Haiku19.5Reka Flash 38.7
  • Follows unfamiliar, precisely checkable instructionsIFBench+5.7points aheadClaude 3 Haiku36.1Reka Flash 330.4
  • Answers hard knowledge questions correctlyAA-Omniscience · Accuracy+3.9points aheadClaude 3 Haiku17.6Reka Flash 313.7

Where Reka Flash 3 pulls ahead

  • Graduate-level biology, physics and chemistry questionsGPQA Diamond+15.5points aheadReka Flash 352.9Claude 3 Haiku37.4
  • Code for real scientific research problemsSciCode+8.1points aheadReka Flash 326.7Claude 3 Haiku18.6

Every test, side by side

All 14 tests both models report. The winning score is in its model's colour; marks a score checked independently.

CodingReka Flash 3

Full coding ranking

ReasoningReka Flash 3

Full reasoning ranking

FactsClaude 3 Haiku

Full facts ranking

Long documentsClaude 3 Haiku
  • AA-LCRClaude 3 Haiku by 27.727.70+27.7

Full long documents ranking

Following instructionsClaude 3 Haiku
  • IFBenchClaude 3 Haiku by 5.736.130.4+5.7

Full following instructions ranking

Other results5 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

Questions people ask

Which is better, Claude 3 Haiku or Reka Flash 3?

Claude 3 Haiku wins three of the five areas where both have results: facts, long documents and following instructions. Reka Flash 3 wins coding and reasoning, and costs 33% less.

Which is better for coding?

Reka Flash 3. It wins 1 of the 2 coding tests both models report; Claude 3 Haiku wins none, and 1 is a tie.

Which is cheaper?

Claude 3 Haiku costs $0.25 per million input tokens and $1.25 per million output tokens; Reka Flash 3 costs $0.20 and $0.80. That makes Reka Flash 3 about 33% cheaper for the same work.

How do you compare the two?

We use the 14 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 5 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.