VECTOR WIREAI INTELLIGENCE
PKT
Refresh Models Deals Regulatory Sources

Questions this page answers

Which is better, ERNIE 4.5 or Qwen2.5 Instruct 72B?
Across 14 shared benchmarks, ERNIE 4.5 scores higher on 1 and Qwen2.5 Instruct 72B on 13. The widest gap is simpleqa, where Qwen2.5 Instruct 72B scores 10.3 against 1.8.

ERNIE 4.5 vs Qwen2.5 Instruct 72B

Across 14 shared benchmarks, ERNIE 4.5 scores higher on 1 and Qwen2.5 Instruct 72B on 13. The widest gap is simpleqa, where Qwen2.5 Instruct 72B scores 10.3 against 1.8.

BaiduvsAlibaba14 shared benchmarks113 head-to-head
BenchmarkERNIE 4.5Qwen2.5 Instruct 72B
arc_challenge40.694.5
bbh30.479.8
C-Eval40.789.2
CLUEWSC48.691.4
cmmlu39.889.5
DROP28.676.7
GPQA Diamond7449.1
GSM8K25.295.8
hellaswag3384.8
mmlu_redux43.286.8
MMLU-Pro1671.6
PIQA55.282.6
simpleqa1.810.3
winogrande51.382.3

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.