Maternity Case Record Digitisation (Synthetic Forms): leaderboard

A 2026 benchmark of multimodal LLMs for digitising a handwritten South African maternity case record: each form image is extracted into a JSON template and compared field by field with reference JSON files. This board is field-level exact-match accuracy in percent, empty fields included, median over four synthetic forms in the same layout; higher is better.

Metric: Field-level accuracy (from 0-1, times 100; median over forms): share of form fields, empty fields included, whose normalised extraction exactly matches the ground truth, on four synthetic Maternity Case Records filled with simulated data in the same layout as the real registry form, one form image per call with the optimised extraction prompt and JSON template, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3.1 Flash Lite86#377
2Gemini 3.1 Pro (Preview)84#102
3GPT-5.480#138
4Gemini 2.5 Pro79#280
5Claude Sonnet 4.677#179
6GPT-5.276#190
7GPT-5.2 Pro76#139
8Gemini 2.5 Flash75#466
9Claude Opus 4.673#114
10GPT-4.167#506
11Grok 4.1 FastReasoning67#431
12Claude Haiku 4.562#587
13GPT-5 Mini60#373
14Qwen 2.5 VL 3B48#2664
15GPT-5 Nano46#912

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-synthetic-forms · How It Works · Data refreshed daily, snapshot 2026-11-22.