DBLifeBench - SQL Debugging (Multi-Round): leaderboard

SQL debugging in DBLifeBench with several correction rounds: given a failing SQLite statement and its error message, the model may revise its fix, judged by execution; percent solved, higher is better.

Metric: Debugging success (%; the corrected SQL executes correctly within the multi-round correction loop, 523 erroneous statements with their SQLite error messages; temperature 0.3, top-p 0.2, SQLite). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o72.17#741
2GPT-4o Mini61.83#1623

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=dblifebench-sql-debugging-multi-round · How It Works · Data refreshed daily, snapshot 2026-11-13.