ContrAR (Multiple Frames) - Outdoor Navigation: leaderboard

Metric: Detection accuracy (%) for contradictory virtual content attacks in AR videos (60 outdoor navigation videos; half the videos carry a contradiction, a balanced yes/no decision), first, middle and last frames given (multi-frame prompting); mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 11 models tracked.

Top models

#ModelScore
1GPT-4o90
2GPT-588.33
3GPT-4.185
4Gemini 2.5 Pro81.67
5Gemini 2.5 Flash76.67
6Qwen 2.5 VL 72B Instruct76.67
7Claude Sonnet 4.571.67
8Grok 470
9Qwen 2.5 VL 7B Instruct66.67
10Claude Haiku 4.558.33

Interactive version: theaggregate.ai/benchmark?slug=contrar-multiple-frames-outdoor-navigation · How It Works · Data refreshed daily, snapshot 2026-10-07.