ContrAR (Multiple Frames) - Smart Retail: leaderboard

ContrAR (2026) tests whether vision-language models detect contradictory virtual content attacks in augmented reality, answering yes or no on real AR videos of which half carry an overlay that contradicts the physical scene, given the first, middle and last frames of each video. Detection accuracy in percent on the smart retail videos; higher is better.

Metric: Detection accuracy (%) for contradictory virtual content attacks in AR videos (66 smart retail videos; half the videos carry a contradiction, a balanced yes/no decision), first, middle and last frames given (multi-frame prompting); mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-580.3#178
2GPT-4.178.79#505
3GPT-4o75.76#751
4Grok 469.7#319
5Gemini 2.5 Pro65.15#276
6Gemini 2.5 Flash63.64#463
7Claude Haiku 4.560.61#583
8Qwen 2.5 VL 72B Instruct59.09#841
9Grok 2 Vision59.09#1437
10Claude Sonnet 4.556.06#261
11Qwen 2.5 VL 7B Instruct46.97#1902

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=contrar-multiple-frames-smart-retail · How It Works · Data refreshed daily, snapshot 2026-11-21.