UAV-DualCog - Landmark-Relative Direction: leaderboard

UAV-DualCog (2026) evaluates multimodal LLMs on self-state and environment-state reasoning of a UAV in simulated aerial scenes, with structured answers in instant mode. This board asks where a landmark lies relative to the UAV forward direction; answer accuracy over 1,024 items in percent, higher is better.

Metric: Answer accuracy (%; 1,024 questions asking where a landmark lies relative to the UAV forward direction; structured JSON answers on renders of simulated AerialVLN scenes, the discrete answer scored whatever the predicted box or interval; instant mode with explicit thinking disabled where a model allows it; higher is better). Source: arxiv.org. Saturation forecast: Around June 2028. 36 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.5 (Non-reasoning)65.4#49 (GPT-5.5)
2Qwen 3.5 27B (Non-reasoning)57.8#359 (Qwen 3.5 27B)
3GPT-5.3 Instant56.5#130
4Qwen 3.7 Plus (Non-reasoning)55.4#207 (Qwen 3.7 Plus)
5Qwen 3.5 9B (Non-reasoning)53.2#803 (Qwen 3.5 9B)
6Qwen 3.5 35B A3B (Non-reasoning)53.2#482 (Qwen 3.5 35B A3B)
7MiMo-V2.5 (Non-reasoning)51.2#354 (MiMo-V2.5)
8Qwen 3.5 122B A10B (Non-reasoning)49.7#331 (Qwen 3.5 122B A10B)
9Claude Sonnet 4.648.5#161
10Qwen 3.6 Plus (Non-reasoning)48.4#222 (Qwen 3.6 Plus)
11Qwen 3.5 397B A17B (Non-reasoning)47.9#246 (Qwen 3.5 397B A17B)
12Gemini 3.1 Flash Lite (Non-reasoning)47.6#364 (Gemini 3.1 Flash Lite)
13Qwen 3.5 4B (Non-reasoning)47.5#1175 (Qwen 3.5 4B)
14Kimi K2.6 (Non-reasoning)42.8#178 (Kimi K2.6)
15Kimi K2.5 (Non-reasoning)39.4#256 (Kimi K2.5)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=uav-dualcog-landmark-relative-direction · How It Works · Data refreshed daily, snapshot 2026-11-13.