Granite 4.0 1B vs LFM2.5-1.2B-Instruct
Wins 2 of 6 areas
Coding · Long documents
Wins 3 of 6 areas
Reasoning · Facts · Following instructions
LFM2.5-1.2B-Instruct wins more areas, narrowly.Granite 4.0 1B is better at coding.
Scores updated · 29 tests both models report · How we compare
Where each one wins
Tests won in each of the six areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- ReasoningHard problems that need careful thinking02LFM2.5-1.2B-Instruct2 of 3 tests · 1 tie
- FactsGetting facts right instead of making them up01LFM2.5-1.2B-Instruct1 of 2 tests · 1 tie
- Following instructionsDoing exactly what it is asked01LFM2.5-1.2B-Instruct1 of 1 test
- CodingWriting and fixing software10Granite 4.0 1B1 of 2 tests · 1 tie
- Long documentsFinding answers in very long texts10Granite 4.0 1B1 of 1 test
- AgentsCarrying out multi-step tasks on its own00Even0 each · 1 tie
Agents, long documents and following instructions rest on a single test each.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where LFM2.5-1.2B-Instruct pulls ahead
- Follows unfamiliar, precisely checkable instructionsIFBench+23.3points ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+8.4points ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+4.5points ahead
Where Granite 4.0 1B pulls ahead
- Code for real scientific research problemsSciCode+6.4points ahead
Every test, side by side
All 29 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingGranite 4.0 1B
- SciCodeGranite 4.0 1B by 6.48.72.3+6.4
- Terminal-Bench Hardtie00tie
ReasoningLFM2.5-1.2B-Instruct
- GPQA DiamondLFM2.5-1.2B-Instruct by 4.528.132.6+4.5
- Humanity's Last ExamLFM2.5-1.2B-Instruct by 1.94.86.7+1.9
- CritPttie00tie
FactsLFM2.5-1.2B-Instruct
- AA-Omniscience · Non-hallucinationLFM2.5-1.2B-Instruct by 8.46.514.9+8.4
- AA-Omniscience · Accuracytie6.27tie
Following instructionsLFM2.5-1.2B-Instruct
- IFBenchLFM2.5-1.2B-Instruct by 23.320.543.8+23.3
Other results19 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- GSM8KGranite 4.0 1B by 69.173.44.3+69.1
- MATH-500 (EM)Granite 4.0 1B by 3944.85.8+39
- J-MATH500LFM2.5-1.2B-Instruct by 24.625.450+24.6
- JHumanEval+Granite 4.0 1B by 22.551.228.7+22.5
- JMMLU-ProXLFM2.5-1.2B-Instruct by 16.115.331.4+16.1
- Avg.LFM2.5-1.2B-Instruct by 1634.150.1+16
- JMMLULFM2.5-1.2B-Instruct by 13.733.947.6+13.7
- τ²-Bench Telecom (AA run)Granite 4.0 1B by 1222.810.8+12
- MMLU-ProLFM2.5-1.2B-Instruct by 10.933.544.4+10.9
- AIME25 no toolsLFM2.5-1.2B-Instruct by 10.73.314+10.7
- AA-OmniscienceLFM2.5-1.2B-Instruct by 9.5-81.6-72.1+9.5
- J-GSM8KLFM2.5-1.2B-Instruct by 7.442.850.2+7.4
- JGPQALFM2.5-1.2B-Instruct by 7.324.431.7+7.3
- IFEvalLFM2.5-1.2B-Instruct by 6.679.686.2+6.6
- J-BFCLv3Granite 4.0 1B by 4.350.646.3+4.3
- AA Agentic IndexGranite 4.0 1B by 47.63.6+4
- BFCL v3Granite 4.0 1B by 3.352.449.1+3.3
- Domain AvgLFM2.5-1.2B-Instruct by 1.238.539.7+1.2
- AA Intelligencetie55.2tie
Questions people ask
Which is better, Granite 4.0 1B or LFM2.5-1.2B-Instruct?
LFM2.5-1.2B-Instruct wins three of the six areas where both have results: reasoning, facts and following instructions. Granite 4.0 1B wins coding and long documents. They are level on agents.
Which is better for coding?
Granite 4.0 1B. It wins 1 of the 2 coding tests both models report; LFM2.5-1.2B-Instruct wins none, and 1 is a tie.
How do you compare the two?
We use the 29 benchmark tests both models have published scores on. The verdict counts the 10 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 19 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.