Maternity Case Record Digitisation - Free-Text WER: leaderboard

A 2026 benchmark of multimodal LLMs for digitising a handwritten South African maternity case record: each form image is extracted into a JSON template and compared field by field with reference JSON files. This board is the word error rate on the free-text fields of the real registry forms, times 100 and able to exceed 100; lower is better.

Metric: Word error rate on the free-text fields (from 0 upward, times 100; can exceed 100), on the real redacted Maternity Case Records (49 forms for Gemini and OpenAI models; 46 for Claude) of the UBOMI BUHLE Pregnancy Exposure Registry (South Africa), one form image per call with the optimised extraction prompt and JSON template, temperature 0, two attempts at valid JSON; lower is better. Source: arxiv.org. Saturation forecast: Around September 2027. 9 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)50#99
2Gemini 3.1 Flash Lite53#371
3Claude Sonnet 4.656#173
4GPT-5.456#135
5Gemini 2.5 Pro60#276
6Gemini 2.5 Flash60#463
7Claude Opus 4.672#113
8GPT-5 Mini72#364
9Claude Haiku 4.582#583

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-free-text-wer · How It Works · Data refreshed daily, snapshot 2026-11-21.