Across 14 shared benchmarks, DeepSeek-V3.1-Base scores higher on 13 and ERNIE 4.5 on 1. The widest gap is MMLU-Pro, where DeepSeek-V3.1-Base scores 58.8 against 16.
| Benchmark | DeepSeek-V3.1-Base | ERNIE 4.5 |
|---|---|---|
| arc_challenge | 95.6 | 40.6 |
| bbh | 88.2 | 30.4 |
| C-Eval | 90 | 40.7 |
| cmmlu | 88.8 | 39.8 |
| DROP | 86.3 | 28.6 |
| GPQA Diamond | 51 | 74 |
| GSM8K | 91.4 | 25.2 |
| hellaswag | 89.2 | 33 |
| HumanEval+ | 64.6 | 25 |
| MBPP+ | 72.2 | 40.2 |
| mmlu_redux | 90 | 43.2 |
| MMLU-Pro | 58.8 | 16 |
| simpleqa | 26.3 | 1.8 |
| winogrande | 85.9 | 51.3 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.