Skip to content
VECTOR WIREAI INTELLIGENCE
⌘K
UTC
Models739Deals30d254Policy30d64, 14 pendingSources1,010

MTOB eng → kalam (ChrF) half book leaderboard — the family board.

8 TRACKED VARIANTS · 1 FIRST-CLASS BOARD

One family, 8 tracked prints. Scoring configs and splits of the base board render as sections of this page, each under its own honest label.

● LIVE DATA6 MODELS ON THIS BOARDLEADER GPT-4O AT 54.3

The board — MTOB eng → kalam (ChrF) half bookTOP 6 OF 6 MEASURED · BEST SCORE PER MODEL, DEFAULT VARIANT

#ModelVendorScoreVLast seen
01GPT-4oOpenAI54.32026-06-06
02Gemini 1.5 ProGoogle53.72026-06-06
03Claude 3.5 SonnetAnthropic53.62026-06-06
04MiniMax Text 01MiniMax51.72026-06-06
05Gemini 2.0 Flash ExpGoogle49.52026-06-06
06Qwen LongAlibaba48.52026-06-06
◆ IV — INDEPENDENTLY VERIFIED · ◆ AA — AGGREGATOR · ◆ VA — VENDOR · ◇ SA — SOURCE-ATTRIBUTED

Variants of this boardSCORING CONFIGS & SPLITS — NOT CITED STANDALONE, SO THEY LIVE HERE

MTOB eng → kalam (ChrF) no context

VARIANT6 models · best score per model
#ModelVendorScoreVLast seen
01Claude 3.5 SonnetAnthropic20.22026-06-06
02Gemini 1.5 ProGoogle16.82026-06-06
03Qwen LongAlibaba16.62026-06-06
04Gemini 2.0 Flash ExpGoogle12.22026-06-06
05GPT-4oOpenAI9.92026-06-06
06MiniMax Text 01MiniMax62026-06-06

MTOB kalam → eng (BLEURT) no context

VARIANT6 models · best score per model
#ModelVendorScoreVLast seen
01Gemini 2.0 Flash ExpGoogle33.82026-06-06
02MiniMax Text 01MiniMax33.62026-06-06
03GPT-4oOpenAI33.22026-06-06
04Gemini 1.5 ProGoogle32.02026-06-06
05Claude 3.5 SonnetAnthropic31.42026-06-06
06Qwen LongAlibaba30.12026-06-06

MTOB eng → kalam (ChrF) full book

VARIANT5 models · best score per model
#ModelVendorScoreVLast seen
01Gemini 1.5 ProGoogle57.92026-06-06
02Claude 3.5 SonnetAnthropic55.62026-06-06
03Gemini 2.0 Flash ExpGoogle53.32026-06-06
04MiniMax Text 01MiniMax51.62026-06-06
05Qwen LongAlibaba45.92026-06-06

MTOB kalam → eng (BLEURT) half book

VARIANT5 models · best score per model
#ModelVendorScoreVLast seen
01Gemini 1.5 ProGoogle61.52026-06-06
02Claude 3.5 SonnetAnthropic59.72026-06-06
03GPT-4oOpenAI58.32026-06-06
04Gemini 2.0 Flash ExpGoogle57.52026-06-06
05Qwen LongAlibaba53.12026-06-06

Other tracked prints

THIN BOARDSunder 5 published models each — listed, never hidden
PrintLeaderScoreModels
MTOB kalam → eng (BLEURT) full bookGemini 1.5 Pro63.14
MTOB eng → kalam (half book)Gemini 1.5 Pro53.73
MTOB eng → kalam (full book)Qwen Long45.91
THE FAMILY BOARD · EVERY PRINT LABELED · EVERY SCORE SOURCE-ATTRIBUTED ON ITS OWN LIVE BOARDAll leaderboardsThe frontier boardModels by vendor