Maternity Case Record Digitisation - Free-Text CER: leaderboard
A 2026 benchmark of multimodal LLMs for digitising a handwritten South African maternity case record: each form image is extracted into a JSON template and compared field by field with reference JSON files. This board is the character error rate on the free-text fields of the real registry forms, times 100 and able to exceed 100; lower is better.
Metric: Character error rate on the free-text fields (from 0 upward, times 100; can exceed 100), on the real redacted Maternity Case Records (49 forms for Gemini and OpenAI models; 46 for Claude) of the UBOMI BUHLE Pregnancy Exposure Registry (South Africa), one form image per call with the optimised extraction prompt and JSON template, temperature 0, two attempts at valid JSON; lower is better. Source: arxiv.org. Saturation forecast: Around September 2027. 9 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 31 | #99 |
| 2 | Claude Sonnet 4.6 | 37 | #173 |
| 3 | Gemini 2.5 Pro | 40 | #276 |
| 4 | Gemini 3.1 Flash Lite | 40 | #371 |
| 5 | GPT-5.4 | 43 | #135 |
| 6 | Gemini 2.5 Flash | 45 | #463 |
| 7 | Claude Opus 4.6 | 54 | #113 |
| 8 | GPT-5 Mini | 64 | #364 |
| 9 | Claude Haiku 4.5 | 69 | #583 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-free-text-cer · How It Works · Data refreshed daily, snapshot 2026-11-21.