LED (Box Overlay) - Error Detection: leaderboard

Metric: Document-level error detection accuracy (%): whether the predicted layout of a page contains any structural error, given only the page image with the predicted boxes drawn on it, on LED's 4,996 DocLayNet test pages with structural layout errors (missing, hallucinated, resized, misclassified, split, merged, overlapping, duplicated regions) injected at the rates a commercial layout model produces, zero-shot via OpenRouter at temperature 1.0; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro62.6#145
2Gemini 2.5 Flash58.6#237
3GPT-4o56.7#333
4Llama 4 Scout46.8#646
5GPT-4o Mini46#588
6Llama 4 Maverick43.5#451
7Gemini 2.5 Flash Lite43.5#413

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=led-box-overlay-error-detection · How It Works · Data refreshed daily, snapshot 2026-10-11.