StatFormBench - Variable Precision: leaderboard

Variable precision on StatFormBench: the share of variables a model identifies as relevant that match the reference variable set (StatFormBench, arXiv 2609.01982v2, Table 1). Percent; higher is better; penalizes over-prediction.

Metric: Precision (%). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash66.1#103
2Claude Opus 4.665.8#67
3Claude Sonnet 4.665#94
4DeepSeek V4 Pro64.9#112
5Gemini 3.1 Pro (Preview)64.5#64
6Kimi K2.561.3#152
7Qwen 3.5 397B A17B60.5#154
8DeepSeek V4 Flash56.1#155
9GPT-5.453.7#83
10GPT-5.553.7#33
11Qwen 3.5 9B51.6#391
12Qwen 3.5 4B48.7#514
13Qwen 3.5 2B32#1114
14Qwen 3.5 0.8B8.3#1410

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=statformbench-variable-precision · How It Works · Data refreshed daily, snapshot 2026-11-05.