VeriOCRBench - Visual Dimension (Assisted): leaderboard

The visual verification dimension of VeriOCRBench (Zhou et al., 2026): 400 OCR-grounded tasks with the traps image degradation and occluded target, where the text or visual evidence the question needs is unreadable or hidden. Diagnosis accuracy is the percentage on which the model both rejects the task and names the correct trap mechanism, judged by GPT-4o; higher is better. Assisted setting: the prompt tells the model to check that the task is completable before answering.

Metric: Diagnosis accuracy (%; the 400 trap-injected tasks of the visual verification dimension (image degradation and occluded target: the required text or visual evidence is unreadable or hidden); the model must reject the task and name the ground-truth trap mechanism; judged by GPT-4o at temperature 0; assisted paradigm: a meta-instruction asks the model to verify the task first). Source: arxiv.org. Saturation forecast: Around February 2028. 15 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 397B A17B72#242
2Qwen 3.5 122B A10B71#329
3Claude Sonnet 4.570.75#244
4GPT-569.25#163
5Qwen 3.5 35B A3B68.5#480
6GPT-4o66.25#741
7InternVL3-38B65.75#905
8Llama 4 Scout56.5#1787
9Llama 4 Maverick55.25#1105
10Gemini 3.1 Pro (Preview)12.5#91

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=veriocrbench-visual-dimension-assisted · How It Works · Data refreshed daily, snapshot 2026-11-12.