FlinkEval v3.1 Ladder L2.4 - Ground Truth Pass: leaderboard

FlinkEval tests natural-language requests for Flink SQL. Ground-truth-anchored correctness, face-value judgments and execution errors are separate metrics. The main comparison uses 666 questions; the specification-ladder study uses a matched 600-question cohort, with each information condition retained. This board reports adjudicated ground truth pass rate (%). Higher is better.

Metric: Adjudicated ground truth pass rate (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.

Top models

#ModelScoreOverall rank
1GPT-6 Astra51.3#6

Interactive version: theaggregate.ai/benchmark?slug=flinkeval-v3-1-ladder-l2-4-ground-truth-pass · How It Works · Data refreshed daily, snapshot 2026-11-16.