ChartJudgeBench - CPA Component Positioning: leaderboard

Metric: Pairwise judging accuracy (%; the 154 component positioning pairs; two-pass position-swapped protocol: each of ChartJudgeBench's 1,003 human-filtered chart pairs (an original chart and a copy with one injected flaw) is judged twice with the order reversed and counts as correct only if the judge picks the better chart both times; temperature 0.1). Source: arxiv.org. Saturation forecast: Around December 2026. 26 models tracked.

Top models

#ModelScore
1Gemini 3 Pro90.9
2GPT-5.282.5
3Qwen 2.5 VL 72B Instruct77.9
4Qwen 3 VL 32B Instruct77.3
5Qwen 3 VL 8B Instruct57.8
6Claude Sonnet 4.540.3
7Qwen 3 VL 30B A3B (Thinking)29.9
8Qwen 2 VL 7B Instruct4.5
9Qwen 2.5 VL 7B Instruct1.9

Interactive version: theaggregate.ai/benchmark?slug=chartjudgebench-cpa-component-positioning · How It Works · Data refreshed daily, snapshot 2026-09-26.