Maternity Case Record Digitisation - Free-Text WER: leaderboard
Metric: Word error rate on the free-text fields (from 0 upward, times 100; can exceed 100), on the 49 real redacted Maternity Case Records of the UBOMI BUHLE Pregnancy Exposure Registry (South Africa), one form image per call with the optimised extraction prompt and JSON template, temperature 0, two attempts at valid JSON; lower is better. Source: arxiv.org. Saturation forecast: Around September 2027. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 50 |
| 2 | Gemini 3.1 Flash Lite | 53 |
| 3 | Claude Sonnet 4.6 | 56 |
| 4 | GPT-5.4 | 56 |
| 5 | Gemini 2.5 Pro | 60 |
| 6 | Gemini 2.5 Flash | 60 |
| 7 | Claude Opus 4.6 | 72 |
| 8 | GPT-5 Mini | 72 |
| 9 | Claude Haiku 4.5 | 82 |
Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-free-text-wer · How It Works · Data refreshed daily, snapshot 2026-10-07.