VIABench - VQA: leaderboard

VIABench (Nanjing University, 2026) evaluates multimodal LLMs as assistants for visually impaired people on first-person videos recorded or shared by blind users. In this task the model answers a question about the surroundings at a timestamp, given the video up to that point; GPT-5 scores similarity to the reference answer from 0 to 100, higher is better.

Metric: Visual question answering score (0-100): answers to questions about the environment or objects asked at a timestamp of a blind user video, given the video up to that point, judged by GPT-5 as the semantic similarity (0 to 1, reported times 100) between the model answer and the ground-truth annotation, on first-person videos recorded or shared by visually impaired people, with each model at its default frame sampling; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-562.9#167
2Gemini 2.5 Pro58.8#266
3GPT-4o (2024-08-06)56.6#740
4Qwen 2.5 VL 7B38.9#1787

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=viabench-vqa · How It Works · Data refreshed daily, snapshot 2026-11-13.