ROSE - Local Click: leaderboard

Metric: Strict PASS (%) on T3 local clicking: the exact coordinates of every exception inside a numerically specified region, macro-averaged over the five visual sources, on the 5,560-instance test split of ROSE v0.1: grid images of repeated majority elements with a few exceptions, from five controlled visual sources (confusable Chinese glyphs, emoji styles and identities, pixel-art edits and assets); strict PASS requires an exact count or an exact set of clicked grid coordinates in the prescribed answer grammar; temperature 0, reasoning or thinking disabled where supported; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

#ModelScore
1GPT-5.5 (Non-reasoning)93.6
2Gemini 3.1 Pro (Preview)75.4
3Qwen 3.6 Plus (Non-reasoning)39.5
4Claude Sonnet 4.69.8
5Claude Opus 4.89.8
6GLM-4.6V (Non-reasoning)5

Interactive version: theaggregate.ai/benchmark?slug=rose-local-click · How It Works · Data refreshed daily, snapshot 2026-09-29.