Gemini 3.6 Flash vs Llama 3.1 Instruct 405B
Wins 4 of 5 areas
Coding · Agents · Reasoning · Long documents
Wins 0 of 5 areas
—
Gemini 3.6 Flash is the stronger all-rounder.
Scores updated · 13 tests both models report · How we compare
Where each one wins
Tests won in each of the five areas where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.
- ReasoningHard problems that need careful thinking30Gemini 3.6 Flash3 of 3 tests
- CodingWriting and fixing software20Gemini 3.6 Flash2 of 2 tests
- AgentsCarrying out multi-step tasks on its own10Gemini 3.6 Flash1 of 1 test
- Long documentsFinding answers in very long texts10Gemini 3.6 Flash1 of 1 test
- FactsGetting facts right instead of making them up11Even1 each
Agents and long documents rest on a single test each.
What it costs
Prices per million tokens, roughly 750,000 words. The bars show the cost of a million tokens read plus a million written.
The biggest differences
The tests each model wins by the widest margin, up to three each. Scores are out of 100.
Where Gemini 3.6 Flash pulls ahead
- Reasons across sets of long documentsAA-LCR+54.7points ahead
- Long, multi-file coding tasks in real codebasesSWE-bench Pro+47.5points ahead
- Graduate-level biology, physics and chemistry questionsGPQA Diamond+41.3points ahead
Where Llama 3.1 Instruct 405B pulls ahead
- Avoids making up answers it doesn't knowAA-Omniscience · Non-hallucination+3.2points ahead
Every test, side by side
All 13 tests both models report. The winning score is in its model's colour; marks a score checked independently.
CodingGemini 3.6 Flash
- SWE-bench ProGemini 3.6 Flash by 47.558.711.2+47.5
- SciCodeGemini 3.6 Flash by 23.553.429.9+23.5
ReasoningGemini 3.6 Flash
- GPQA DiamondGemini 3.6 Flash by 41.392.851.5+41.3
- Humanity's Last ExamGemini 3.6 Flash by 36.840.84+36.8
- CritPtGemini 3.6 Flash by 10.610.60+10.6
FactsEven
- AA-Omniscience · AccuracyGemini 3.6 Flash by 26.85023.2+26.8
- AA-Omniscience · Non-hallucinationLlama 3.1 Instruct 405B by 3.244.447.6+3.2
Other results4 tests, not counted
Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.
- Artificial Analysis Coding IndexGemini 3.6 Flash by 54.769.214.5+54.7
- AA-OmniscienceGemini 3.6 Flash by 39.222.1-17.1+39.2
- AA IntelligenceGemini 3.6 Flash by 26.7347.3+26.7
- AA Agentic IndexGemini 3.6 Flash by 23.930.26.3+23.9
Questions people ask
Which is better, Gemini 3.6 Flash or Llama 3.1 Instruct 405B?
Gemini 3.6 Flash wins four of the five areas where both have results: coding, agents, reasoning and long documents. Llama 3.1 Instruct 405B wins none. They are level on facts.
Which is better for coding?
Gemini 3.6 Flash. It wins 2 of the 2 coding tests both models report; Llama 3.1 Instruct 405B wins none.
How do you compare the two?
We use the 13 benchmark tests both models have published scores on. The verdict counts the 9 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 4 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.