Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

Granite 4.0 H Tiny vs Llama 3.2 3B Instruct

IBM · released

Wins 2 of 3 areas

Coding · Reasoning

Meta · released

Wins 1 of 3 areas

Following instructions

Granite 4.0 H Tiny is the stronger all-rounder.Llama 3.2 3B Instruct is better at following instructions.

Scores updated · 13 tests both models report · How we compare

Where each one wins

Tests won in each of the three areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

Coding, reasoning and following instructions rest on a single test each.

What it costs

Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.

Granite 4.0 H TinyNo current price is tracked.
Llama 3.2 3B Instruct$0.05 to read · $0.33 to write$0.38Price from meta-llama

The biggest differences

The tests each model wins by the widest margin, up to three each. Scores are out of 100.

Where Granite 4.0 H Tiny pulls ahead

  • Recent programming contest problemsLiveCodeBench v6+15.2points aheadGranite 4.0 H Tiny26.7Llama 3.2 3B Instruct11.5
  • Graduate-level biology, physics and chemistry questionsGPQA Diamond+1points aheadGranite 4.0 H Tiny26.5Llama 3.2 3B Instruct25.5

Where Llama 3.2 3B Instruct pulls ahead

  • Follows unfamiliar, precisely checkable instructionsIFBench+7.8points aheadLlama 3.2 3B Instruct26.2Granite 4.0 H Tiny18.4

Every test, side by side

All 13 tests both models report. The winning score is in its model's colour; marks a score checked independently.

CodingGranite 4.0 H Tiny

Full coding ranking

ReasoningGranite 4.0 H Tiny

Full reasoning ranking

Following instructionsLlama 3.2 3B Instruct
  • IFBenchLlama 3.2 3B Instruct by 7.818.426.2+7.8

Full following instructions ranking

Other results10 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

  • HumanEval+Granite 4.0 H Tiny by 49.773.824.1+49.7
  • GSMPlusGranite 4.0 H Tiny by 20.459.138.7+20.4
  • MATH-500 (EM)Granite 4.0 H Tiny by 1758.241.2+17
  • LCB v5Granite 4.0 H Tiny by 15.827.311.5+15.8
  • MGSMGranite 4.0 H Tiny by 15.573.758.2+15.5
  • MMMLUGranite 4.0 H Tiny by 8.256.147.9+8.2
  • MMLUGranite 4.0 H Tiny by 6.466.860.4+6.4
  • GSM8KGranite 4.0 H Tiny by 4.982.677.7+4.9
  • IFEvalGranite 4.0 H Tiny by 3.781.177.4+3.7
  • MMLU-ProLlama 3.2 3B Instruct by 33235+3

Questions people ask

Which is better, Granite 4.0 H Tiny or Llama 3.2 3B Instruct?

Granite 4.0 H Tiny wins two of the three areas where both have results: coding and reasoning. Llama 3.2 3B Instruct wins following instructions.

Which is better for coding?

Granite 4.0 H Tiny. It wins the one coding test both models report.

How do you compare the two?

We use the 13 benchmark tests both models have published scores on. The verdict counts the 3 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 10 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.