CiteVQA - Evidence Recall: leaderboard
CiteVQA (2026) asks multimodal models to answer questions over long PDFs, 1,897 questions on 711 documents in seven domains, and to cite the exact page elements that support each answer as bounding boxes. This board is the recall of the key evidence elements, a cited box matching one at IoU 0.5 or more, in percent over all questions; higher is better.
Metric: Recall (%) of the crucial evidence elements matched by a cited box at IoU 0.5, over all 1,897 questions, the model answers from the document pages and cites element-level bounding boxes, unified prompt, temperature 1.0, at most 4,096 output tokens, Qwen3-VL-235B-A22B judge; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 20 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | High | 66 | #99 |
| 2 | Gemini 3 Flash (Preview) | High | 45.4 | #152 |
| 3 | GPT-5.4 | xHigh | 31 | #135 |
| 4 | Seed 2.0 Pro | 28.5 | #222 | |
| 5 | Gemini 2.5 Pro | Thinking, 32K | 27.4 | #276 |
| 6 | GPT-5.2 | xHigh | 18.2 | #185 |
| 7 | GLM-5V Turbo | 14.9 | #360 | |
| 8 | Gemma 4 31B | 11.6 | #382 | |
| 9 | Qwen 3 VL 235B A22B Instruct | 11.3 | #532 | |
| 10 | Qwen 3.6 Plus | 7.7 | #238 | |
| 11 | Qwen 3 VL 32B Instruct | 6.6 | #606 | |
| 12 | Kimi K2.5 | 6.2 | #266 | |
| 13 | Qwen 3.5 397B A17B | 5.4 | #264 | |
| 14 | Qwen 3.5 27B | 5.3 | #375 | |
| 15 | Qwen 3.5 122B A10B | 3.9 | #346 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=citevqa-evidence-recall · How It Works · Data refreshed daily, snapshot 2026-11-21.