DI-Bench (Data Intelligence) - Czech Financial: leaderboard

Metric: Accuracy (%; 282 PKDD 99 Czech retail-banking generated data-intelligence questions whose answers need retrieved business rules and metric definitions plus SQL over the database; agent with SQL-execution and knowledge-base tools, at most 20 turns, temperature 0, via the Amazon Bedrock Converse API; exact match with task-specific tolerance). Source: arxiv.org. Saturation forecast: Around September 2027. 4 models tracked.

Top models

#ModelScore
1Claude Opus 4.655.7
2Claude Haiku 4.542.9
3DeepSeek V3.242.6
4Qwen 3 Next 80B A3B39.7

Interactive version: theaggregate.ai/benchmark?slug=di-bench-data-intelligence-czech-financial · How It Works · Data refreshed daily, snapshot 2026-09-26.