IndicDB (Zero-Shot with Evidence) - Hindi: leaderboard

Metric: Execution accuracy (%) of generated SQL on the Hindi variant of the IndicDB Text-to-SQL tasks (20 databases built from Indian government open data, join depth up to six), zero-shot prompting with the task's external evidence; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.

Top models

#ModelScore
1DeepSeek V3.267.73
2MiniMax-M2.767.13
3Llama 3.3 70B Instruct61.27
4Qwen 3 8B42.44

Interactive version: theaggregate.ai/benchmark?slug=indicdb-zero-shot-with-evidence-hindi · How It Works · Data refreshed daily, snapshot 2026-10-07.