Eye-Q - Iterative Refinement - Cross-Lingual: leaderboard
Eye-Q (Najar et al., 2026), cross-lingual visual word puzzles from the Aftabe game (322 items) whose Persian answers need an English-Persian bridge of words, sounds or letters: each image encodes a hidden word or phrase through visual cues, and the model must output the exact target. The model may revise twice after being told its answer is wrong, and the puzzle counts if any of the three attempts is right. Exact-match accuracy in percent; higher is better.
Metric: Exact-Match Accuracy (%; up to three attempts, told when wrong, cross-lingual English-Persian subset). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 23.82 | #262 |
| 2 | Grok 4.1 Fast (Reasoning) | 15.99 | #426 (Grok 4.1 Fast) |
| 3 | Gemini 2.5 Flash | 7.84 | #452 |
| 4 | GPT-5.2 (Non-reasoning) | 5.02 | #172 (GPT-5.2) |
| 5 | Qwen 3 VL 235B A22B Instruct | 3.13 | #521 |
| 6 | Llama 4 Scout | 1.25 | #1787 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=eye-q-iterative-refinement-cross-lingual · How It Works · Data refreshed daily, snapshot 2026-11-12.