Eye-Q - Basic - Arabic: leaderboard
Eye-Q (Najar et al., 2026), Arabic visual word puzzles (50 synthetic scenes written by the authors): each image encodes a hidden word or phrase through visual cues, and the model must output the exact target. The prompt gives the game rules and the answer length in characters, and the model answers once. Exact-match accuracy in percent; higher is better.
Metric: Exact-Match Accuracy (%; basic prompt with the answer length in characters, Arabic subset). Source: arxiv.org. Saturation forecast: Around September 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 14.89 | #262 |
| 2 | Grok 4.1 Fast (Reasoning) | 6.38 | #426 (Grok 4.1 Fast) |
| 3 | GPT-5.2 (Non-reasoning) | 6.38 | #172 (GPT-5.2) |
| 4 | Gemini 2.5 Flash | 2.13 | #452 |
| 5 | Qwen 3 VL 235B A22B Instruct | 0 | #521 |
| 6 | Llama 4 Scout | 0 | #1787 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=eye-q-basic-arabic · How It Works · Data refreshed daily, snapshot 2026-11-12.