Eye-Q - Few-Shot CoT - Persian: leaderboard

Eye-Q (Najar et al., 2026), Persian visual word puzzles (671 items from the Aftabe mobile game): each image encodes a hidden word or phrase through visual cues, and the model must output the exact target. The prompt adds three solved examples from the same subset, each with its key clues and candidate answers. Exact-match accuracy in percent; higher is better.

Metric: Exact-Match Accuracy (%; three solved examples from the same subset, Persian subset). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro30.88#262
2Grok 4.1 Fast (Reasoning)19.04#426 (Grok 4.1 Fast)
3Gemini 2.5 Flash18.44#452
4GPT-5.2 (Non-reasoning)9.45#172 (GPT-5.2)
5Qwen 3 VL 235B A22B Instruct3.3#521
6Llama 4 Scout1.8#1787

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=eye-q-few-shot-cot-persian · How It Works · Data refreshed daily, snapshot 2026-11-12.