ChartJudgeBench - CPA Visual Style: leaderboard

Metric: Pairwise judging accuracy (%; the 88 visual style pairs; two-pass position-swapped protocol: each of ChartJudgeBench's 1,003 human-filtered chart pairs (an original chart and a copy with one injected flaw) is judged twice with the order reversed and counts as correct only if the judge picks the better chart both times; temperature 0.1). Source: arxiv.org. Saturation forecast: Estimated already saturated. 26 models tracked.

Top models

#ModelScore
1Gemini 3 Pro98.9
2GPT-5.279.5
3Qwen 2.5 VL 72B Instruct58
4Qwen 3 VL 32B Instruct55.7
5Claude Sonnet 4.540.9
6Qwen 3 VL 8B Instruct33
7Qwen 3 VL 30B A3B (Thinking)28.4
8Qwen 2 VL 7B Instruct10.2
9Qwen 2.5 VL 7B Instruct3.4

Interactive version: theaggregate.ai/benchmark?slug=chartjudgebench-cpa-visual-style · How It Works · Data refreshed daily, snapshot 2026-09-26.