Across 16 shared benchmarks, NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 scores higher on 13 and NVIDIA Nemotron 3 Nano 30B A3B on 2, with 1 level. The widest gap is RULER 1M, where NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 scores 69.6 against 51.2.
| Benchmark | NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 | NVIDIA Nemotron 3 Nano 30B A3B |
|---|---|---|
| AGIEval-En | 70 | 68.5 |
| arc_challenge | 92.7 | 92 |
| Global-MMLU-Lite (5-shot) Average | 75.5 | 74.6 |
| GSM8K | 91.3 | 91.4 |
| hellaswag | 85.5 | 85.5 |
| humaneval | 77.4 | 75 |
| MBPP | 78.6 | 73.8 |
| Minerva Math | 82.8 | 82.6 |
| mmlu | 78.6 | 78.5 |
| MMLU-Pro | 67.9 | 78.3 |
| OpenBookQA | 47.6 | 46.8 |
| PIQA (acc-norm) | 85.2 | 84.3 |
| PIQA (acc) | 83.3 | 82.6 |
| RULER 1M | 69.6 | 51.2 |
| RULER 256K | 76.9 | 71.7 |
| winogrande | 80 | 79.2 |
Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.