Across 13 shared benchmarks, DeepSeek-V2 scores higher on 12 and ERNIE 4.5 on 1. The widest gap is MMLU-Pro, where DeepSeek-V2 scores 58.5 against 16.
| Benchmark | DeepSeek-V2 | ERNIE 4.5 |
|---|---|---|
| arc_challenge | 92.4 | 40.6 |
| bbh | 78.9 | 30.4 |
| C-Eval | 81.7 | 40.7 |
| CLUEWSC | 89.9 | 48.6 |
| cmmlu | 84 | 39.8 |
| DROP | 80.1 | 28.6 |
| GPQA Diamond | 35.3 | 74 |
| GSM8K | 79.2 | 25.2 |
| hellaswag | 87.8 | 33 |
| mmlu_redux | 77.9 | 43.2 |
| MMLU-Pro | 58.5 | 16 |
| PIQA | 83.9 | 55.2 |
| winogrande | 86.3 | 51.3 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.