FlinkEval v3.1 Ladder L1.1 - Ground Truth Pass: leaderboard
FlinkEval tests natural-language requests for Flink SQL. Ground-truth-anchored correctness, face-value judgments and execution errors are separate metrics. The main comparison uses 666 questions; the specification-ladder study uses a matched 600-question cohort, with each information condition retained. This board reports adjudicated ground truth pass rate (%). Higher is better.
Metric: Adjudicated ground truth pass rate (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 78 | #6 |
Interactive version: theaggregate.ai/benchmark?slug=flinkeval-v3-1-ladder-l1-1-ground-truth-pass · How It Works · Data refreshed daily, snapshot 2026-11-16.