AIDABench (Pass@1) - Data Visualization: leaderboard

Metric: Score (%) on the 116 data-visualization tasks, a single run (pass@1), AIDABench's 603 end-to-end data-analytics tasks over real business files (mostly spreadsheets, up to 14 files per task); the model works in a Python sandbox through one execute_code tool (at most 20 calls) with an auxiliary spreadsheet summary, provider-recommended decoding; QA answers are judged pass/fail by QwQ-32B against the reference, charts get a 0-1 rubric score from a Gemini-3-Pro-Preview judge, spreadsheets pass/fail from a Claude-Sonnet-4.5 file evaluator; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.567.71#138
2Gemini 3 Pro (Preview)63.87#64
3Qwen 3 Max (2026-01-23)63.53#151
4Qwen 3 235B A22B 2507 Instruct63.15#291
5DeepSeek V3.2 (Non-reasoning)62.51#198 (DeepSeek V3.2)
6DeepSeek V3.2 (Thinking)60.83#198 (DeepSeek V3.2)
7Kimi K2 (Thinking)59.97#236 (Kimi K2)
8Qwen 3 30B A3B 2507 (Thinking)50.94#366 (Qwen 3 30B A3B 2507)
9Qwen 3 30B A3B 2507 Instruct47.57#464

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=aidabench-pass-1-data-visualization · How It Works · Data refreshed daily, snapshot 2026-10-11.