Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

Gemma 3 27B vs Phi 3 Vision 128K Instruct

Google · released

Wins 1 of 1 area

Images and charts

Microsoft · released

Wins 0 of 1 area

—

Gemma 3 27B is the stronger all-rounder.

Scores updated · 6 tests both models report · How we compare

Where each one wins

Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

What it costs

Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.

Gemma 3 27B$0.08 to read · $0.16 to write$0.24Price from deepinfra
Phi 3 Vision 128K InstructNo current price is tracked.

The biggest differences

The tests each model wins by the widest margin, up to three each. Scores are out of 100.

Where Gemma 3 27B pulls ahead

  • College exam questions with charts, maps and diagramsMMMU+24.5points aheadGemma 3 27B64.9Phi 3 Vision 128K Instruct40.4
  • Math problems shown in pictures and chartsMathVista+23.1points aheadGemma 3 27B67.6Phi 3 Vision 128K Instruct44.5

Where Phi 3 Vision 128K Instruct pulls ahead

No clear win on a test scored out of 100.

Every test, side by side

All 6 tests both models report. The winning score is in its model's colour; marks a score checked independently.

Images and chartsGemma 3 27B
  • LMArena · VisionGemma 3 27B by 352.3 rating points1164811.7+352.3 rating
  • MMMUGemma 3 27B by 24.564.940.4+24.5
  • MathVistaGemma 3 27B by 23.167.644.5+23.1

Full images and charts ranking

Other results3 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

  • AI2DGemma 3 27B by 7.884.576.7+7.8
  • TextVQAPhi 3 Vision 128K Instruct by 5.865.170.9+5.8
  • ChartQAPhi 3 Vision 128K Instruct by 3.47881.4+3.4

Questions people ask

Which is better, Gemma 3 27B or Phi 3 Vision 128K Instruct?

Gemma 3 27B wins the one area where both have results: images and charts. Phi 3 Vision 128K Instruct wins none.

How do you compare the two?

We use the 6 benchmark tests both models have published scores on. The verdict counts the 3 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 3 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.