SceneFunRI: leaderboard

In real-world scenes, target objects may reside in regions that are not visible. While humans can often infer the locations of occluded objects from context and commonsense knowledge, this capability remains a major challenge for vision-language models (VLMs). To address this gap, we introduce SceneFunRI, a benchmark for Reasoning the Invisible. Based on the SceneFun3D dataset, SceneFunRI formulat

Metric: cacc_75 (self-reported). Source: benchmarklist.com. Saturation forecast: Around June 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash15.2#99
2Qwen 3.5 122B A10B12.63#173
3Qwen 3.5 9B11.11#379
4Qwen 3.5 4B10.99#475
5Qwen 3.5 27B7.95#187
6Gemma 3 27B (IT)7.6#523
7Gemma 3 4B (IT)4.21#992
8Gemma 3 12B (IT)4.09#664
9InternVL3-8B4.09#620
10InternVL3-38B3.86#405
11Qwen 3.5 0.8B3.63#1424

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=scenefunri · How It Works · Data refreshed daily, snapshot 2026-10-20.