Refresh Models —Deals —Regulatory —Sources —

Llama 3.1 Instruct 405B vs MiniMax M2.7

18 SHARED BENCHMARKS

Across 18 shared benchmarks, Llama 3.1 Instruct 405B scores higher on 0 and MiniMax M2.7 on 18. The widest gap is HLE, where MiniMax M2.7 scores 29.6 against 4.2.

METAVSMINIMAX18 SHARED0–18 HEAD-TO-HEAD

BenchmarkLlama 3.1 Instruct 405BMARGINMiniMax M2.7

AA Agentic Index6.325.9

AA Intelligence8.538.9

AA-LCR24.775.3

AA-Omniscience-17.10.8

Artificial Analysis Coding Index14.552.6

GPQA Diamond51.587.4

HLE4.229.6

MMLU-Pro73.481.9

OmniScience Accuracy23.226.8

OmniScience Non-Hallucination4965.6

SWE-bench Pro11.256.2

SWE-bench Verified24.579.9

Terminal-Bench Hard6.839.4

τ²-Bench Telecom (AA run)1984.8

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.

Compare Llama 3.1 Instruct 405B withEVERY TRACKED PAIRING

▶Anthropic12 PAIRINGS

Claude Opus 4.8 Claude Opus 4.6 Claude Sonnet 4.5 Claude 3.5 Sonnet Claude Opus 4.5 Claude Fable 5 Claude Opus 5 Claude Opus 4.7 Claude Sonnet 4 Claude Sonnet 4.6 Claude Sonnet 5 Claude Opus 4

▶OpenAI11 PAIRINGS

GPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.2 GPT-5.4 GPT-5 o3 GPT-5.1 o4-mini o1 GPT-4o mini

▶Google11 PAIRINGS

Gemini 3.1 Pro Gemini 3 Pro Gemma 4 26B A4B Gemini 1.5 Pro Gemma 4 31B Gemini 2.5 Pro Gemini 3.5 Flash Gemini 3 Flash Preview Gemini 3.6 Flash Gemma 4 E2B Gemini 2.5 Flash

▶Alibaba11 PAIRINGS

Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3 VL 4B (Reasoning)Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus Qwen3.6 27B Qwen3.6 35B A3B Qwen3.7 Max Qwen3.5 122B A10B Qwen3.7 Plus Preview

▶DeepSeek5 PAIRINGS

DeepSeek-V3 DeepSeek-V4-Pro DeepSeek-V3.2 DeepSeek-V4-Flash DeepSeek-R1

▶Moonshot4 PAIRINGS

Kimi K2.5 Kimi K2.6 Kimi K3 Kimi K2 Instruct

▶Meta1 PAIRING

▶Z.ai2 PAIRINGS

GLM-5.1 GLM-5.2

▶NVIDIA1 PAIRING

Nemotron 3 Super 120B A12B

Compare MiniMax M2.7 withEVERY TRACKED PAIRING

▶Anthropic12 PAIRINGS

Claude Opus 4.8 Claude Opus 4.6 Claude Sonnet 4.5 Claude 3.5 Sonnet Claude Opus 4.5 Claude Fable 5 Claude Opus 5 Claude Opus 4.7 Claude Sonnet 4 Claude Sonnet 4.6 Claude Sonnet 5 Claude Opus 4

▶OpenAI11 PAIRINGS

GPT-5.5 GPT-4o GPT-5.6 Sol GPT-5.2 GPT-5.4 GPT-5 o3 GPT-5.1 o4-mini o1 GPT-4o mini

▶Google11 PAIRINGS

Gemini 3.1 Pro Gemini 3 Pro Gemma 4 26B A4B Gemini 1.5 Pro Gemma 4 31B Gemini 2.5 Pro Gemini 3.5 Flash Gemini 3 Flash Preview Gemini 3.6 Flash Gemma 4 E2B Gemini 2.5 Flash

▶Alibaba11 PAIRINGS

Qwen3.5 35B A3B Qwen3.5 397B A17B Qwen3 VL 4B (Reasoning)Qwen2.5 Instruct 72B Qwen3.5 27B Qwen3.6 Plus Qwen3.6 27B Qwen3.6 35B A3B Qwen3.7 Max Qwen3.5 122B A10B Qwen3.7 Plus Preview

▶DeepSeek5 PAIRINGS

DeepSeek-V3 DeepSeek-V4-Pro DeepSeek-V3.2 DeepSeek-V4-Flash DeepSeek-R1

▶Moonshot4 PAIRINGS

Kimi K2.5 Kimi K2.6 Kimi K3 Kimi K2 Instruct

▶Meta1 PAIRING

▶Z.ai2 PAIRINGS

GLM-5.1 GLM-5.2

▶NVIDIA1 PAIRING

Nemotron 3 Super 120B A12B