Elorian Glimpse Card - CountQA: leaderboard
CountQA counting questions about product images. Elorian reported this for its Glimpse research preview (October 16, 2026), running every model at its highest thinking effort with its native tools: Glimpse at max, GPT-6 Astra at max with Code Interpreter, GPT-6.1 Sol and Claude Opus 5.5 at max effort with Code Interpreter, and Gemini 3.8 Flash at high with Code Interpreter. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://elorian.ai/blog/introducing-glimpse
Metric: Accuracy (%). Source: elorian.ai. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra (Max) | 86.42 | #6 (GPT-6 Astra) |
| 2 | GPT-6.1 Sol (Max) | 86.42 | #7 (GPT-6.1 Sol) |
| 3 | Claude Opus 5.5 (Max) | 82.2 | #3 (Claude Opus 5.5) |
| 4 | Gemini 3.8 Flash (High) | 81.09 | #22 (Gemini 3.8 Flash) |
No result here: #8 Gemini 4 Argon, #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=elorian-glimpse-card-countqa · How It Works · Data refreshed daily, snapshot 2026-10-19.