Across 12 shared benchmarks, DeepSeek-V3 scores higher on 9 and NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 on 3. The widest gap is OpenBookQA, where DeepSeek-V3 scores 95.4 against 48.6.
| Benchmark | DeepSeek-V3 | NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16 |
|---|---|---|
| arc_challenge | 95.3 | 97.3 |
| GPQA Diamond | 68.4 | 50 |
| GSM8K | 96.7 | 88.1 |
| hellaswag | 88.9 | 90.5 |
| humaneval | 92.1 | 83.8 |
| MATH | 91.2 | 82 |
| mgsm | 79.8 | 87.7 |
| mmlu | 89.4 | 89.1 |
| MMLU-Pro | 81.2 | 79.1 |
| OpenBookQA | 95.4 | 48.6 |
| PIQA | 84.7 | 83.8 |
| winogrande | 84.9 | 79.3 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.