SpatialQuery-1M - Closest-Instance Distance: leaderboard

Metric: Acc@0.2m (%; share of 5,000 fixed closest-instance distance queries covering all 200 scenes whose estimated gravity-aligned floor-plane distance between the reference object and its nearest same-category candidate is within 0.2 m of the ground truth; black-image sanity filter: a query earns credit only when the model returns valid outputs for both the original RGB image and a same-size uniform black image, is correct on the original and incorrect on the black image; invalid outputs score zero; zero-shot, identical decoding settings). Source: arxiv.org. Saturation forecast: Around 2038. 11 models tracked.

Top models

#ModelScore
1GPT-4o Mini27.86
2Qwen 2.5 VL 7B15.5
3Gemini 2.5 Pro13.68
4Gemini 2.5 Flash11.32
5GPT-4o6.04

Interactive version: theaggregate.ai/benchmark?slug=spatialquery-1m-closest-instance-distance · How It Works · Data refreshed daily, snapshot 2026-09-29.