MTOB (Machine Translation from One Book) — Reverse direction AND different metric (BLEURT vs ChrF) from eng→kalam family.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 1.5 Pro | 63.1 | 1 | 2026-06-06 | |
| 2 | Claude 3.5 Sonnet | Anthropic | 62.3 | 1 | 2026-06-06 |
| 3 | Gemini 2.0 Flash Exp | 57 | 1 | 2026-06-06 | |
| 4 | Qwen Long | Alibaba | 32.1 | 1 | 2026-06-06 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.