IndicDB (Zero-Shot without Evidence) - Telugu: leaderboard

IndicDB (2026) is a multilingual Text-to-SQL benchmark on relational databases built from Indian government open data, with the same tasks and gold SQL asked in English, Hindi, Bengali, Marathi, Tamil, Telugu and Hinglish. This board is execution accuracy in percent of the generated SQL on the Telugu questions, using zero-shot prompting without the external evidence; higher is better.

Metric: Execution accuracy (%) of generated SQL on the Telugu variant of the IndicDB Text-to-SQL tasks (20 databases built from Indian government open data, join depth up to six), zero-shot prompting without the external evidence; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1DeepSeek V3.252.94#419
2MiniMax-M2.748.23#539
3Llama 3.3 70B Instruct39.46#1385
4Qwen 3 8B34.5#1873

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=indicdb-zero-shot-without-evidence-telugu · How It Works · Data refreshed daily, snapshot 2026-11-21.