The two are evenly matched.Gemma 4 E2B is better at following instructions; LFM2-VL-3B at images and charts.
Scores updated · 32 tests both models report · How we compare
Where each one wins
Tests won in each of the two areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
Following instructions rests on a single test.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where LFM2-VL-3B pulls ahead
Every test, side by side
All 32 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Images and chartsLFM2-VL-3B
Following instructionsGemma 4 E2B
- IFBenchGemma 4 E2B by 17.23820.8+17.2
Other results25 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- ChartQA TestLFM2-VL-3B by 37.243.280.4+37.2
- ChartQALFM2-VL-3B by 36.943.580.4+36.9
- ScreenSpot-v2 MobileGemma 4 E2B by 35.342.97.6+35.3
- ScreenSpot-v2 DesktopGemma 4 E2B by 22.128.16+22.1
- TextVQA-valLFM2-VL-3B by 20.562.583+20.5
- ScreenSpot-v2 WebGemma 4 E2B by 19.922.42.5+19.9
- MMELFM2-VL-3B by 18.154.973+18.1
- MMBenchLFM2-VL-3B by 15.864.280+15.8
- MM-IFEvalGemma 4 E2B by 14.265.651.4+14.2
- Multilingual MMBenchLFM2-VL-3B by 13.562.876.3+13.5
- HallusionBenchGemma 4 E2B by 13.459.846.4+13.4
- InfographicVQA (val)LFM2-VL-3B by 13.454.467.8+13.4
- BFCLv4Gemma 4 E2B by 12.733.220.5+12.7
- OCRBench v1LFM2-VL-3B by 11.570.281.7+11.5
- RealWorldQALFM2-VL-3B by 11.16071.1+11.1
- RefCOCO (Macro Prec@1)Gemma 4 E2B by 10.267.357.1+10.2
- IFEvalGemma 4 E2B by 10.18372.9+10.1
- Multilingual MMMBLFM2-VL-3B by 8.673.381.9+8.6
- MMMBLFM2-VL-3B by 7.674.381.9+7.6
- SimpleVQALFM2-VL-3B by 5.727.333+5.7
- POPELFM2-VL-3B by 5.28489.2+5.2
- SEED-Bench (image)LFM2-VL-3B by 5.271.476.6+5.2
- MMMU (val) (Pass@1)LFM2-VL-3B by 4.541.145.6+4.5
- DocVQA-valLFM2-VL-3B by 4.185.789.8+4.1
- OCRBench v2_entie43.543.9tie
Questions people ask
Which is better, Gemma 4 E2B or LFM2-VL-3B?
Gemma 4 E2B and LFM2-VL-3B each win one of the two areas where both have results. Gemma 4 E2B wins following instructions; LFM2-VL-3B wins images and charts.
How do you compare the two?
We use the 32 benchmark tests both models have published scores on. The verdict counts the 7 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 25 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.