ExChart-Bench - Scatter Plots: leaderboard
ExChart-Bench (He et al., Zhejiang University, CHI 2026) gives a multimodal model a chart image with its data labels removed and a CSV template with the values masked, and asks it to fill in the numbers. This board covers the 700 scatter plots (8,414 values). Adaptive MAPE divides each value's absolute error by the chart's largest absolute value and caps it at 100%, and unparsable output or a table of the wrong shape counts as 100% error; lower is better.
Metric: Adaptive MAPE (%; 8,414 values in 700 charts, per-value error relative to the chart's largest absolute value, capped at 100; unparsable or misshapen tables count 100). Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Flash | 2.63 | #452 |
| 2 | Qwen 2.5 VL 72B Instruct | 4.63 | #845 |
| 3 | GLM-4.5V | 4.79 | #739 |
| 4 | Qwen 2.5 VL 32B Instruct | 5.11 | #1055 |
| 5 | GPT-4.1 | 5.77 | #492 |
| 6 | GPT-4o | 7.61 | #741 |
| 7 | Qwen 2.5 VL 7B Instruct | 8.18 | #1842 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=exchart-bench-scatter-plots · How It Works · Data refreshed daily, snapshot 2026-11-12.