LED (Box Overlay) - Error Type F1: leaderboard

Metric: Document-level error-type F1 (x 100): multi-label classification of which of eight structural error types the page layout contains, given only the page image with the predicted boxes drawn on it, on LED's 4,996 DocLayNet test pages with structural layout errors (missing, hallucinated, resized, misclassified, split, merged, overlapping, duplicated regions) injected at the rates a commercial layout model produces, zero-shot via OpenRouter at temperature 1.0; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro49#145
2Gemini 2.5 Flash37.2#237
3Gemini 2.5 Flash Lite22.9#413
4GPT-4o8.5#333
5Llama 4 Maverick4#451
6Llama 4 Scout1.3#646
7GPT-4o Mini0.9#588

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=led-box-overlay-error-type-f1 · How It Works · Data refreshed daily, snapshot 2026-10-11.