Scores updated · 2 tests both models report · How we compare
Every test, side by side
All 2 tests both models report. The winning score is in its model's colour; marks a score checked independently.
Other results2 tests
- MMLU-ProLlama 3.1 Instruct 405B by 36.573.336.8+36.5
- MMLU-ReduxLlama 3.1 Instruct 405B by 24.586.261.7+24.5
Questions people ask
How do you compare the two?
We use the 2 benchmark tests both models have published scores on. None of them is in the eight capability areas we count, so this page lists them without a verdict. Each score is the one shown on the model's own page.