ExChart-Bench - Bar Charts: leaderboard

ExChart-Bench (He et al., Zhejiang University, CHI 2026) gives a multimodal model a chart image with its data labels removed and a CSV template with the values masked, and asks it to fill in the numbers. This board covers the 800 basic, grouped and stacked bar charts (9,500 values). Adaptive MAPE divides each value's absolute error by the chart's largest absolute value and caps it at 100%, and unparsable output or a table of the wrong shape counts as 100% error; lower is better.

Metric: Adaptive MAPE (%; 9,500 values in 800 charts, per-value error relative to the chart's largest absolute value, capped at 100; unparsable or misshapen tables count 100). Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash3.78#452
2GLM-4.5V3.83#739
3Qwen 2.5 VL 72B Instruct8.81#845
4Qwen 2.5 VL 32B Instruct10.17#1055
5GPT-4.110.53#492
6Qwen 2.5 VL 7B Instruct13.72#1842
7GPT-4o13.87#741

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=exchart-bench-bar-charts · How It Works · Data refreshed daily, snapshot 2026-11-12.