Interactive Visual Grounding (None): leaderboard

The Interactive Visual Grounding benchmark (2026) casts a vision-language model as the Matcher in a reference game: a simulated Director describes target items drawn from human-grounded image sets of dogs, baskets and tangrams, and the model must pick each target from a grid, asking clarification questions where the protocol allows. In the None protocol the Matcher gets no description, the Director answering only yes, no or unclear. Score is the share of targets matched correctly, in percent; higher is better.

Metric: Matcher accuracy (%; share of target items the model selects correctly given no description, the Director answering only yes, no or unclear; micro-averaged over 536 target items of four human-grounded image sets (dogs, two basket sets, tangrams), with GPT-5.4 as the simulated Director answering from the human description; a 10-turn budget per target, utterances capped at 50 words). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.5 (2026-04-23)59.7#33
2Gemini 3.1 Pro (Preview)56.7#94
3GPT-5.4 (2026-03-05)43.2#87
4Gemini 3.1 Flash Lite (Preview)37.9#418
5Gemma 4 31B (IT)26.4#342
6Qwen 3 VL 32B Instruct23.9#585
7Qwen 3 VL 8B Instruct21.6#981
8GPT-5.4 Mini (2026-03-17)13.5#287

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=interactive-visual-grounding-none · How It Works · Data refreshed daily, snapshot 2026-11-13.