UAVQA-Bench - Quantity Awareness: leaderboard
UAVQA-Bench (Fudan University, 2026) asks multimodal models 1,500 human-annotated questions about drone images drawn from 13 public UAV datasets, mostly multiple choice with some bounding-box grounding. This dimension covers scene and regional counting and number comparison. Score is accuracy in percent; higher is better.
Metric: Accuracy (%; scene and regional counting and number comparison; direct answering over UAVQA-Bench: 1,500 human-annotated questions on images from 13 public UAV datasets, 16 tasks in six capability dimensions, multiple choice plus box grounding counted correct at IoU 0.5). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Pro | 76.29 | #137 |
| 2 | Gemini 3 Flash | 71.71 | #164 |
| 3 | Qwen 3 VL 30B A3B (Thinking) | 69.43 | #712 |
| 4 | Qwen 3 VL 32B Instruct | 67.71 | #585 |
| 5 | Qwen 3 VL 32B (Thinking) | 67.14 | #559 |
| 6 | Qwen 3.5 9B | 65.14 | #803 |
| 7 | Qwen 3 VL 8B (Thinking) | 64.86 | #887 |
| 8 | Qwen 3 VL 8B Instruct | 64.57 | #981 |
| 9 | Qwen 3 VL 30B A3B Instruct | 58.57 | #871 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=uavqa-bench-quantity-awareness · How It Works · Data refreshed daily, snapshot 2026-11-13.