VECTOR WIREAI INTELLIGENCE
PKT
Refresh Models Deals Regulatory Sources

Questions this page answers

Which is better, Gemma 4 26B A4B or NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16?
Across 16 shared benchmarks, Gemma 4 26B A4B scores higher on 5 and NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 on 11. The widest gap is Minerva Math, where NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 scores 82.8 against 43.7.

Gemma 4 26B A4B vs NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16

Across 16 shared benchmarks, Gemma 4 26B A4B scores higher on 5 and NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 on 11. The widest gap is Minerva Math, where NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16 scores 82.8 against 43.7.

GooglevsNVIDIA16 shared benchmarks511 head-to-head
BenchmarkGemma 4 26B A4BNVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16
AGIEval-En55.370
arc_challenge92.892.7
Global-MMLU-Lite (5-shot) Average74.875.5
GSM8K7791.3
hellaswag85.385.5
humaneval5077.4
MBPP68.478.6
Minerva Math43.782.8
mmlu77.878.6
MMLU-Pro85.267.9
OpenBookQA48.847.6
PIQA (acc-norm)83.885.2
PIQA (acc)82.283.3
RULER 1M72.969.6
RULER 256K85.776.9
winogrande79.180

Best tracked score per model per benchmark (default configuration; source-attributed). ↓ marks lower-is-better metrics. Open either model for its full surface, provenance and pricing.