LED (Box Overlay + JSON) - Error Detection: leaderboard

Metric: Document-level error detection accuracy (%): whether the predicted layout of a page contains any structural error, given the page image with the predicted boxes drawn on it plus the layout JSON, on LED's 4,996 DocLayNet test pages with structural layout errors (missing, hallucinated, resized, misclassified, split, merged, overlapping, duplicated regions) injected at the rates a commercial layout model produces, zero-shot via OpenRouter at temperature 1.0; higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash61.4#237
2Gemini 2.5 Pro60.3#145
3GPT-4o59.1#333
4GPT-4o Mini56#588
5Llama 4 Scout51.5#646
6Llama 4 Maverick46.8#451
7Gemini 2.5 Flash Lite43.2#413

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=led-box-overlay-plus-json-error-detection · How It Works · Data refreshed daily, snapshot 2026-10-11.