Skip to content
VECTOR WIREAI INTELLIGENCE
⌘K
UTC
Models799Deals30d257Policy30d76, 16 pendingSources1,136

Phi 3 Vision 128K Instruct vs Phi 4 Multimodal Instruct

Microsoft · released

Wins 0 of 1 area

—

Microsoft · released

Wins 1 of 1 area

Images and charts

Phi 4 Multimodal Instruct is the stronger all-rounder.

Scores updated · 8 tests both models report · How we compare

Where each one wins

Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

What it costs

Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.

Phi 3 Vision 128K InstructNo current price is tracked.
Phi 4 Multimodal Instruct$0.08 to read · $0.32 to write$0.40Price from Artificial Analysis

The biggest differences

The tests each model wins by the widest margin, up to three each. Scores are out of 100.

Where Phi 4 Multimodal Instruct pulls ahead

  • Math problems shown in pictures and chartsMathVista+17.9points aheadPhi 4 Multimodal Instruct62.4Phi 3 Vision 128K Instruct44.5
  • College exam questions with charts, maps and diagramsMMMU+14.7points aheadPhi 4 Multimodal Instruct55.1Phi 3 Vision 128K Instruct40.4

Where Phi 3 Vision 128K Instruct pulls ahead

No clear win on a test scored out of 100.

Every test, side by side

All 8 tests both models report. The winning score is in its model's colour; marks a score checked independently.

Images and chartsPhi 4 Multimodal Instruct
  • MathVistaPhi 4 Multimodal Instruct by 17.944.562.4+17.9
  • MMMUPhi 4 Multimodal Instruct by 14.740.455.1+14.7

Full images and charts ranking

Other results6 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

  • InterGPSPhi 4 Multimodal Instruct by 10.538.148.6+10.5
  • MMBenchPhi 4 Multimodal Instruct by 6.280.586.7+6.2
  • AI2DPhi 4 Multimodal Instruct by 5.676.782.3+5.6
  • TextVQAPhi 4 Multimodal Instruct by 4.770.975.6+4.7
  • POPEtie85.885.6tie
  • ChartQAtie81.481.4tie

Questions people ask

Which is better, Phi 3 Vision 128K Instruct or Phi 4 Multimodal Instruct?

Phi 4 Multimodal Instruct wins the one area where both have results: images and charts. Phi 3 Vision 128K Instruct wins none.

How do you compare the two?

We use the 8 benchmark tests both models have published scores on. The verdict counts the 2 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 6 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.