Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

Gemma 4 E2B vs Phi 4 Multimodal Instruct

Google · released

Wins 2 of 3 areas

Coding · Reasoning

Microsoft · released

Wins 1 of 3 areas

Images and charts

Gemma 4 E2B is the stronger all-rounder.Phi 4 Multimodal Instruct is better at images and charts.

Scores updated · 15 tests both models report · How we compare

Where each one wins

Tests won in each of the three areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

Coding rests on a single test.

The biggest differences

The three tests each model wins by the widest margin. Scores are out of 100.

Where Gemma 4 E2B pulls ahead

  • Harder college exam questions with imagesMMMU-Pro+30.1points aheadGemma 4 E2B44.6Phi 4 Multimodal Instruct14.5
  • Graduate-level biology, physics and chemistry questionsGPQA Diamond+11.8points aheadGemma 4 E2B43.3Phi 4 Multimodal Instruct31.5
  • Code for real scientific research problemsSciCode+9.9points aheadGemma 4 E2B20.9Phi 4 Multimodal Instruct11

Where Phi 4 Multimodal Instruct pulls ahead

  • Math problems shown in pictures and chartsMathVista+24.6points aheadPhi 4 Multimodal Instruct62.4Gemma 4 E2B37.8
  • Visual perception tasks people solve at a glanceBLINK+16.1points aheadPhi 4 Multimodal Instruct61.3Gemma 4 E2B45.2
  • Questions that truly need the image to answerMMStar+15.9points aheadPhi 4 Multimodal Instruct61.2Gemma 4 E2B45.3

Every test, side by side

All 15 tests both models report. The winning score is in its model's colour; marks a score checked independently.

CodingGemma 4 E2B
  • SciCodeGemma 4 E2B by 9.920.911+9.9

Full coding ranking

ReasoningGemma 4 E2B

Full reasoning ranking

Images and chartsPhi 4 Multimodal Instruct
  • MMMU-ProGemma 4 E2B by 30.144.614.5+30.1
  • MathVistaPhi 4 Multimodal Instruct by 24.637.862.4+24.6
  • BLINKPhi 4 Multimodal Instruct by 16.145.261.3+16.1
  • MMStarPhi 4 Multimodal Instruct by 15.945.361.2+15.9
  • OCRBenchPhi 4 Multimodal Instruct by 12.571.984.4+12.5
  • OCRBenchv2Gemma 4 E2B by 6.644.738.1+6.6

Full images and charts ranking

Other results6 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

  • ChartQAPhi 4 Multimodal Instruct by 37.943.581.4+37.9
  • TextVQA-valGemma 4 E2B by 22.662.539.9+22.6
  • MMBenchPhi 4 Multimodal Instruct by 22.564.286.7+22.5
  • DocVQA-valPhi 4 Multimodal Instruct by 7.185.792.8+7.1
  • AA IntelligenceGemma 4 E2B by 27.85.8+2
  • POPEPhi 4 Multimodal Instruct by 1.68485.6+1.6

Questions people ask

Which is better, Gemma 4 E2B or Phi 4 Multimodal Instruct?

Gemma 4 E2B wins two of the three areas where both have results: coding and reasoning. Phi 4 Multimodal Instruct wins images and charts.

Which is better for coding?

Gemma 4 E2B. It wins the one coding test both models report.

How do you compare the two?

We use the 15 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 6 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.