Maternity Case Record Digitisation - Discrete Fields Weighted F1: leaderboard
A 2026 benchmark of multimodal LLMs for digitising a handwritten South African maternity case record: each form image is extracted into a JSON template and compared field by field with reference JSON files. This board is support-weighted F1 on a 0 to 100 scale over the discrete selection fields of the real registry forms; higher is better.
Metric: Support-weighted F1 (from 0-1, times 100) over the discrete selection fields treated as multi-class classification with null as its own class, on the real redacted Maternity Case Records (49 forms for Gemini and OpenAI models; 46 for Claude) of the UBOMI BUHLE Pregnancy Exposure Registry (South Africa), one form image per call with the optimised extraction prompt and JSON template, temperature 0, two attempts at valid JSON; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 91 | #99 |
| 2 | GPT-5.4 | 89 | #135 |
| 3 | Gemini 2.5 Flash | 87 | #463 |
| 4 | Gemini 3.1 Flash Lite | 87 | #371 |
| 5 | Gemini 2.5 Pro | 85 | #276 |
| 6 | Claude Sonnet 4.6 | 84 | #173 |
| 7 | Claude Opus 4.6 | 83 | #113 |
| 8 | Claude Haiku 4.5 | 75 | #583 |
| 9 | GPT-5 Mini | 40 | #364 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-discrete-fields-weighted-f1 · How It Works · Data refreshed daily, snapshot 2026-11-21.