METATR - Printed: leaderboard
METATR (2026) tests text recognition systems, from OCR engines to large multimodal models, on diverse real-world documents from archives and libraries in 29 languages with many scripts and layouts. This board is the character error rate in percent on the printed documents, which can exceed 100 when a system inserts or hallucinates text; lower is better.
Metric: Character error rate (%) on the printed documents, METATR v1.0 (documents from public collections in 29 languages and many scripts and layouts), page-level transcription with the generic instruction (or the recommended OCR prompt of an OCR-tuned model), default hyperparameters, standardized text normalization; can exceed 100 when the output inserts text; lower is better. Source: arxiv.org. Saturation forecast: Around March 2027. 16 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Pro | 17.6 | #145 |
| 2 | Azure Document Intelligence Layout | 30.8 | |
| 3 | Qwen 3 VL 8B | 31.6 | #917 |
| 4 | olmOCR-2 | 38.6 | |
| 5 | Churro-3B | 41 | |
| 6 | RolmOCR | 51.1 | |
| 7 | PeroOCR | 53.2 | |
| 8 | Claude Opus 4.5 | 53.5 | #160 |
| 9 | Mistral OCR | 56.1 | |
| 10 | Mistral Large 3 | 56.6 | #832 |
| 11 | Mistral Medium 3 | 57.9 | #1096 |
| 12 | GPT-5.1 | 58.9 | #240 |
| 13 | LightOnOCR-2-1B | 65.2 | |
| 14 | Mistral Small 3.1 | 66.1 | #1706 |
| 15 | DeepSeek-OCR-2 | 67.5 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=metatr-printed · How It Works · Data refreshed daily, snapshot 2026-11-21.