ContrAR (Single Frame) - Smart Apartment: leaderboard
ContrAR (2026) tests whether vision-language models detect contradictory virtual content attacks in augmented reality, answering yes or no on real AR videos of which half carry an overlay that contradicts the physical scene, given the middle frame of each video. Detection accuracy in percent on the smart apartment videos; higher is better.
Metric: Detection accuracy (%) for contradictory virtual content attacks in AR videos (90 smart apartment videos; half the videos carry a contradiction, a balanced yes/no decision), one middle frame of each video given (single-frame prompting); mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 94.44 | #178 |
| 2 | Gemini 2.5 Flash | 88.89 | #463 |
| 3 | Gemini 2.5 Pro | 86.67 | #276 |
| 4 | GPT-4.1 | 84.44 | #505 |
| 5 | GPT-4o | 77.78 | #751 |
| 6 | Claude Sonnet 4.5 | 64.44 | #261 |
| 7 | Qwen 2.5 VL 72B Instruct | 62.22 | #841 |
| 8 | Grok 4 | 61.11 | #319 |
| 9 | Qwen 2.5 VL 7B Instruct | 57.78 | #1902 |
| 10 | Grok 2 Vision | 57.78 | #1437 |
| 11 | Claude Haiku 4.5 | 48.89 | #583 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=contrar-single-frame-smart-apartment · How It Works · Data refreshed daily, snapshot 2026-11-21.