LongVQUBench - Open-Ended Completeness: leaderboard

Metric: Completeness score (%; how fully the answer captures the key information of the reference answer; GPT-5 judge score of each free-form answer against the expert reference answer, rated 0 to 1 and averaged over the local, cross-event and global levels, reported in percent; open-ended questions of the 60% held-out test split, same frame budgets as the multiple-choice runs). Source: arxiv.org. Saturation forecast: Around April 2027. 10 models tracked.

Top models

#ModelScore
1GPT-545.8
2Qwen 3 VL 8B Instruct39.2

Interactive version: theaggregate.ai/benchmark?slug=longvqubench-open-ended-completeness · How It Works · Data refreshed daily, snapshot 2026-09-29.