GlotOCR Bench - Mid-Resource Scripts: leaderboard

Metric: Acc@5 (%): share of sentences transcribed with CER at most 0.05, macro-averaged over scripts, mid-resource tier (9 scripts such as Arabic, Cyrillic, Devanagari), on GlotOCR Bench (16,375 real multilingual sentences rendered as clean images across 158 Unicode scripts; zero-shot transcription; CER is the character edit distance with whitespace ignored, capped at 1, best of four output normalizations); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 14 models tracked.

Top models

#ModelScore
1Gemini 3.1 Flash Lite82.7
2GPT-4.166.7

Interactive version: theaggregate.ai/benchmark?slug=glotocr-bench-mid-resource-scripts · How It Works · Data refreshed daily, snapshot 2026-10-07.