Maternity Case Record Digitisation - Hallucination Rate: leaderboard
Metric: Hallucination rate (from 0-1, times 100): share of extracted field values that are fabricated (filled in where the ground truth has no such value), on the 49 real redacted Maternity Case Records of the UBOMI BUHLE Pregnancy Exposure Registry (South Africa), one form image per call with the optimised extraction prompt and JSON template, temperature 0, two attempts at valid JSON; lower is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.4 | 6 |
| 2 | Gemini 3.1 Pro (Preview) | 8 |
| 3 | Gemini 3.1 Flash Lite | 8 |
| 4 | Claude Opus 4.6 | 10 |
| 5 | Gemini 2.5 Flash | 11 |
| 6 | Claude Sonnet 4.6 | 12 |
| 7 | Gemini 2.5 Pro | 14 |
| 8 | GPT-5 Mini | 17 |
| 9 | Claude Haiku 4.5 | 23 |
Interactive version: theaggregate.ai/benchmark?slug=maternity-case-record-digitisation-hallucination-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.