METATR - Handwritten: leaderboard

METATR (2026) tests text recognition systems, from OCR engines to large multimodal models, on diverse real-world documents from archives and libraries in 29 languages with many scripts and layouts. This board is the character error rate in percent on the handwritten documents, which can exceed 100 when a system inserts or hallucinates text; lower is better.

Metric: Character error rate (%) on the handwritten documents, METATR v1.0 (documents from public collections in 29 languages and many scripts and layouts), page-level transcription with the generic instruction (or the recommended OCR prompt of an OCR-tuned model), default hyperparameters, standardized text normalization; can exceed 100 when the output inserts text; lower is better. Source: arxiv.org. Saturation forecast: Around March 2027. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro28.5#145
2Claude Opus 4.531.2#160
3Mistral OCR43.6
4Azure Document Intelligence Layout49.1
5Qwen 3 VL 8B54.9#917
6Churro-3B58.1
7GPT-5.159.5#240
8Mistral Medium 360#1096
9Mistral Large 364.3#832
10PeroOCR73.9
11RolmOCR89.6
12olmOCR-295.3
13DeepSeek-OCR-2104.4
14DeepSeek-OCR234.5
15LightOnOCR-2-1B255.7

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=metatr-handwritten · How It Works · Data refreshed daily, snapshot 2026-11-21.