MTOB (Machine Translation from One Book) — kalam→eng, no-context baseline, distinct from full/half-book siblings.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 2.0 Flash Exp | 33.8 | 1 | 2026-06-06 | |
| 2 | MiniMax Text 01 | MiniMax | 33.6 | 1 | 2026-06-06 |
| 3 | GPT-4o | OpenAI | 33.2 | 1 | 2026-06-06 |
| 4 | Gemini 1.5 Pro | 32 | 1 | 2026-06-06 | |
| 5 | Claude 3.5 Sonnet | Anthropic | 31.4 | 1 | 2026-06-06 |
| 6 | Qwen Long | Alibaba | 30.1 | 1 | 2026-06-06 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.