FlinkEval v3.1 Ladder L1.2 - Execution Errors: leaderboard

FlinkEval tests natural-language requests for Flink SQL. Ground-truth-anchored correctness, face-value judgments and execution errors are separate metrics. The main comparison uses 666 questions; the specification-ladder study uses a matched 600-question cohort, with each information condition retained. This board reports execution error rate (%). Lower is better.

Metric: Execution error rate (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.

Top models

#ModelScoreOverall rank
1GPT-6 Astra22.2#6

Interactive version: theaggregate.ai/benchmark?slug=flinkeval-v3-1-ladder-l1-2-execution-errors · How It Works · Data refreshed daily, snapshot 2026-11-16.