Scores updated · 9 tests both models report · How we compare
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
LFM2.5-1.2B-JP-202606No current price is tracked.
Llama 3.2 Instruct 1B$0.03 to read · $0.20 to writePrice from meta-llama
Every test, side by side
All 9 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results9 tests
- J-MATH500LFM2.5-1.2B-JP-202606 by 51.462.811.4+51.4
- Avg.LFM2.5-1.2B-JP-202606 by 44.262.518.3+44.2
- J-GSM8KLFM2.5-1.2B-JP-202606 by 3762.225.2+37
- Domain AvgLFM2.5-1.2B-JP-202606 by 31.953.121.2+31.9
- JHumanEval+LFM2.5-1.2B-JP-202606 by 31.749.417.7+31.7
- J-BFCLv3LFM2.5-1.2B-JP-202606 by 26.94821.1+26.9
- JMMLU-ProXLFM2.5-1.2B-JP-202606 by 20.336.215.9+20.3
- JMMLULFM2.5-1.2B-JP-202606 by 20.254.234+20.2
- JGPQALlama 3.2 Instruct 1B by 3.628.732.3+3.6
Questions people ask
How do you compare the two?
We use the 9 benchmark tests both models have published scores on. None of them is in the eight capability areas we count, so this page lists them without a verdict. Each score is the one shown on the model's own page.