JaWildText - Handwriting OCR: leaderboard

Metric: Handwriting OCR score (0-1, scaled to 0-100): max(0, 1 - character error rate) of page-level transcriptions of 1,065 photos of multi-sentence handwritten Japanese (paper, tablets and whiteboards; horizontal and vertical writing) after NFKC normalization, zero-shot open-weight VLM inference at temperature 0 with up to 2,048 output tokens, one image at its original resolution, a fixed prompt per task and unparseable outputs scored 0; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 3 27B (IT)53#509
2Gemma 3 12B (IT)51#655
3Gemma 3 4B (IT)20#971

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=jawildtext-handwriting-ocr · How It Works · Data refreshed daily, snapshot 2026-10-11.