MTOB (Machine Translation from One Book) — kalam→eng, half-book context, distinct from full-book/no-context siblings.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 1.5 Pro | 61.5 | 1 | 2026-06-06 | |
| 2 | Claude 3.5 Sonnet | Anthropic | 59.7 | 1 | 2026-06-06 |
| 3 | GPT-4o | OpenAI | 58.3 | 1 | 2026-06-06 |
| 4 | Gemini 2.0 Flash Exp | 57.5 | 1 | 2026-06-06 | |
| 5 | Qwen Long | Alibaba | 53.1 | 1 | 2026-06-06 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.