MTOB (Machine Translation from One Book) — Low-resource translation-from-grammar-book eval; full-book is distinct context length.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | Gemini 1.5 Pro | 57.9 | 1 | 2026-06-06 | |
| 2 | Claude 3.5 Sonnet | Anthropic | 55.6 | 1 | 2026-06-06 |
| 3 | Gemini 2.0 Flash Exp | 53.3 | 1 | 2026-06-06 | |
| 4 | MiniMax Text 01 | MiniMax | 51.6 | 1 | 2026-06-06 |
| 5 | Qwen Long | Alibaba | 45.9 | 1 | 2026-06-06 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.