UniQL: leaderboard

UniQL (2026) extends the 1,534 questions of the BIRD text-to-SQL development set to 16 SQL dialects with aligned schemas, data and human-verified gold queries, testing whether text-to-SQL models generalize beyond SQLite. The score is execution accuracy averaged over the 16 dialects: the percent of questions whose single generated query returns the gold result. Higher is better.

Metric: Execution accuracy (%) on all 16 dialects (unweighted mean) of UniQL (1,534 BIRD development-set questions with human-verified SQL in 16 aligned dialects): given the target dialect, schema and question, the model writes one query whose execution result must match the gold result; inference-only, one run; higher is better. Source: arxiv.org. Saturation forecast: Around February 2028. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.554.63#250
2Gemini 2.5 Pro52.1#266
3GPT-5 Mini50.5#348
4GPT-5.1 Codex50.43#288
5DeepSeek V4 Flash48.12#258
6Qwen 3 32B47.77#960
7Qwen 3 8B44.17#1830
8Qwen 3 4B42.29#2281
9Llama 3 70B Instruct39.78#1676
10GPT-3.5 Turbo36.17#2753
11Qwen 3 1.7B33.01#5520
12Llama 3 8B Instruct22.04#4612

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=uniql · How It Works · Data refreshed daily, snapshot 2026-11-13.