HoloCount - Aerial Perspective Shift: leaderboard

Counting objects in aerial drone views: a subset of HoloCount (Meituan, 2026), a visual counting benchmark for multimodal LLMs. Models answer with a single integer, zero-shot; exact-match accuracy in percent, higher is better.

Metric: Accuracy (%; exact-match accuracy of the single integer count a multimodal model returns zero-shot for an image and a counting question, with a strict integer-only system prompt; counting in aerial drone views (109 questions); higher is better). Source: arxiv.org. Saturation forecast: Not forecast. 30 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)82.6#94
2Qwen 3.5 27B82.6#359
3Qwen 3.5 397B A17B78.9#246
4Qwen 3.5 122B A10B78.9#331
5Gemini 3 Flash (Preview)78.9#144
6Qwen 3.5 35B A3B78#482
7Qwen 3.5 9B77.1#803
8Qwen 3.5 4B71.6#1175
9Kimi K2.668.8#178
10Kimi K2.567#256
11Gemini 2.5 Pro63.3#266
12GPT-5.558.7#49
13MiniMax-M341.3#269
14GPT-5.439.4#123
15Claude Opus 4.727.5#79

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=holocount-aerial-perspective-shift · How It Works · Data refreshed daily, snapshot 2026-11-13.