StatFormBench - Variable Recall: leaderboard

Variable recall on StatFormBench: the share of reference variables for a statistical question that the model identifies (StatFormBench, arXiv 2609.01982v2, Table 1). Percent; higher is better; penalizes missed variables.

Metric: Recall (%). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.672.9#67
2Claude Sonnet 4.670.9#94
3DeepSeek V4 Flash70.9#155
4Kimi K2.569.8#152
5Gemini 3 Flash68.9#103
6Gemini 3.1 Pro (Preview)68.3#64
7GPT-5.468.3#83
8DeepSeek V4 Pro67.3#112
9GPT-5.567.2#33
10Qwen 3.5 397B A17B66.5#154
11Qwen 3.5 9B58.1#391
12Qwen 3.5 4B54.9#514
13Qwen 3.5 2B25.2#1114
14Qwen 3.5 0.8B7.6#1410

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=statformbench-variable-recall · How It Works · Data refreshed daily, snapshot 2026-11-05.