FlinkEval v3.1 Ladder L1.1 - Execution Errors: leaderboard
FlinkEval tests natural-language requests for Flink SQL. Ground-truth-anchored correctness, face-value judgments and execution errors are separate metrics. The main comparison uses 666 questions; the specification-ladder study uses a matched 600-question cohort, with each information condition retained. This board reports execution error rate (%). Lower is better.
Metric: Execution error rate (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 22.2 | #6 |
Interactive version: theaggregate.ai/benchmark?slug=flinkeval-v3-1-ladder-l1-1-execution-errors · How It Works · Data refreshed daily, snapshot 2026-11-16.