CiteVQA - Multi-Doc (1-Gold): leaderboard

Metric: Strict attributed accuracy (%): share of questions with answer score at least 4 and either relevance at least 4 or evidence recall at least 0.6, on the multi-document questions with one gold document (25.7 percent of the set), the model answers from the document pages and cites element-level bounding boxes, unified prompt, temperature 1.0, at most 4,096 output tokens, Qwen3-VL-235B-A22B judge; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 20 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview) (High)79.7
2Gemini 3 Flash (Preview) (High)61.8
3GPT-5.4 (xHigh)56.9
4GPT-5.2 (xHigh)38.8
5Seed 2.0 Pro33.5
6Gemma 4 31B29.8
7Qwen 3.5 27B22.6
8Qwen 3.5 397B A17B22.2
9Qwen 3 VL 235B A22B Instruct21.6
10Kimi K2.518.9
11Qwen 3.6 Plus18.5
12Qwen 3.5 9B17.7
13Qwen 3.5 122B A10B17
14Qwen 3 VL 32B Instruct16.2
15Qwen 3.5 35B A3B15.6

Interactive version: theaggregate.ai/benchmark?slug=citevqa-multi-doc-1-gold · How It Works · Data refreshed daily, snapshot 2026-10-07.