VNU-Bench - Narrative Reconstruction: leaderboard

VNU-Bench (Liu et al., University of Florida, 2026) question type in which a multimodal model must reconstruct one coherent account of a story from fragmented reports by several outlets, given a group of YouTube news videos on one event. Each video is given as 4 selected frames and a cleaned transcript cut to 1,000 characters; zero-shot at temperature 0. Accuracy in percent on 4-option multiple-choice questions; higher is better.

Metric: Accuracy (%; question type T9, 4-option multiple choice). Source: arxiv.org. Saturation forecast: Around September 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro56.52#262
2Claude Sonnet 4.555.74#244
3Gemini 2.5 Flash46.9#452
4InternVL3-8B46.08#1695
5Qwen 2.5 VL 7B Instruct45.08#1842

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=vnu-bench-narrative-reconstruction · How It Works · Data refreshed daily, snapshot 2026-11-12.