Skip to content
VECTOR WIREAI INTELLIGENCE
UTC

Kimi K2 Base vs NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16

Moonshot · released

Wins 0 of 1 area

—

NVIDIA · released

Wins 1 of 1 area

Reasoning

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 is the stronger all-rounder.

Scores updated · 16 tests both models report · How we compare

Where each one wins

Tests won in each of the one area where both have results. Each piece is one test, so a longer bar means more evidence; grey means the two scored within a point of each other.

Reasoning rests on a single test.

The biggest differences

The tests each model wins by the widest margin, up to three each. Scores are out of 100.

Where NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 pulls ahead

  • Graduate-level biology, physics and chemistry questionsGPQA Diamond+18.1points aheadNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF1666.2Kimi K2 Base48.1

Where Kimi K2 Base pulls ahead

No clear win on a test scored out of 100.

Every test, side by side

All 16 tests both models report. The winning score is in its model's colour; marks a score checked independently.

ReasoningNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16
  • GPQA DiamondNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 18.148.166.2+18.1

Full reasoning ranking

Other results15 tests, not counted

Tests outside the eight areas. They are not counted above: several are summary scores built from other tests, or the same test under another name.

  • MMLU-ProNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 7.169.276.3+7.1
  • MBPP-SanitizedNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 772.179.1+7
  • WinoGrandeKimi K2 Base by 6.285.379.1+6.2
  • GlobalMMLUNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 5.980.786.6+5.9
  • HellaSwagKimi K2 Base by 5.694.689+5.6
  • MMLUKimi K2 Base by 3.787.884.1+3.7
  • AGIEval-EnNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 3.172.575.7+3.1
  • HumanEvalNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 3.178.281.3+3.1
  • SuperGPQANVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 344.747.6+3
  • MGSMNVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 by 2.385.287.5+2.3
  • OpenBookQAKimi K2 Base by 250.848.8+2
  • RACEtie9291.4tie
  • GSM8Ktie92.191.7tie
  • ARC-Challengetie96.296tie
  • PIQAtie84.985.1tie

Questions people ask

Which is better, Kimi K2 Base or NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16?

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Base-BF16 wins the one area where both have results: reasoning. Kimi K2 Base wins none.

How do you compare the two?

We use the 16 benchmark tests both models have published scores on. The verdict counts the 1 tests in the eight capability areas, and a gap under one point (ten on rating-style scales) counts as a tie. The other 15 are listed but not counted, because several are summary scores or repeat a test. Each score is the one shown on the model's own page.