DocAttriBench - MMLongBench-Doc: leaderboard

Grounded answer generation on the MMLongBench-Doc long documents test split of DocAttriBench (De Grandis et al., 2026), which pairs each question with automatically attributed and filtered evidence regions such as text blocks, tables and figures. An answer counts only when its text matches the reference and its predicted evidence box overlaps an attributed layout element with IoU of at least 0.5; zero-shot, overall answer correctness in percent, higher is better.

Metric: Overall answer correctness (%; grounded answer generation on MMLongBench-Doc (276 test questions): an answer counts only when its text matches the reference and its evidence box is correct; zero-shot, with model-specific prompts and box parsers; element-level evidence boxes from the MAPPET attribution pipeline over Docling layout regions, a box counting when IoU >= 0.5). Source: arxiv.org. Saturation forecast: Around September 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 32B Instruct11.8#1055
2InternVL3-38B4.4#905
3Qwen 2.5 VL 7B Instruct3.7#1842
4InternVL3-8B1.8#1695
5InternVL2.5-2B0#6868

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=docattribench-mmlongbench-doc · How It Works · Data refreshed daily, snapshot 2026-11-12.