VECTOR WIREAI INTELLIGENCE
PKT
Refresh Models Deals Regulatory Sources

Questions this page answers

Which is better, DeepSeek-V2 or Mistral 7B?
Across 12 shared benchmarks, DeepSeek-V2 scores higher on 12 and Mistral 7B on 0. The widest gap is MATH, where DeepSeek-V2 scores 43.6 against 13.1.

DeepSeek-V2 vs Mistral 7B

Across 12 shared benchmarks, DeepSeek-V2 scores higher on 12 and Mistral 7B on 0. The widest gap is MATH, where DeepSeek-V2 scores 43.6 against 13.1.

DeepSeekvsMistral12 shared benchmarks120 head-to-head
BenchmarkDeepSeek-V2Mistral 7B
arc_challenge92.460
bbh78.956.1
C-Eval81.747.4
GPQA Diamond35.324.7
GSM8K79.252.2
hellaswag87.883.2
humaneval48.829.3
MATH43.613.1
MBPP66.651.1
mmlu78.564.2
MMLU-Pro58.530.9
winogrande86.378.4

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.