Across 12 shared benchmarks, DeepSeek-V3.1-Base scores higher on 12 and Mistral 7B on 0. The widest gap is MATH, where DeepSeek-V3.1-Base scores 62.6 against 13.1.
| Benchmark | DeepSeek-V3.1-Base | Mistral 7B |
|---|---|---|
| arc_challenge | 95.6 | 60 |
| bbh | 88.2 | 56.1 |
| C-Eval | 90 | 47.4 |
| GPQA Diamond | 51 | 24.7 |
| GSM8K | 91.4 | 52.2 |
| hellaswag | 89.2 | 83.2 |
| humaneval | 72.5 | 29.3 |
| MATH | 62.6 | 13.1 |
| MBPP | 74.6 | 51.1 |
| mmlu | 87.4 | 64.2 |
| MMLU-Pro | 58.8 | 30.9 |
| winogrande | 85.9 | 78.4 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.