CITBench - Base: leaderboard

CITBench (2026) evaluates LLMs on tabular data processing tasks of matching, cleaning, augmentation and transformation. Scored in the offline single-turn setting as average performance: the mean Level-Accuracy over repeated runs, with partial credit, in percent; higher is better. This board covers the base tier: one input table under simple rules.

Metric: Average performance (%; mean Level-Accuracy with partial credit, each of repeated runs scored 0 to 1, on the offline single-turn tabular data processing tasks of CITBench, a balanced 50% slice of its 1,296 instances in 18 matching, cleaning, augmentation and transformation task types; temperature 1.0, 8,192 output tokens; Base tier: one input table under simple rules). Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash92.26#159
2Claude Sonnet 4.591.35#244
3Gemini 3 Pro86.39#135
4GPT-5.285.79#172
5GLM-4.785.57#365
6GPT-4o80.85#741
7DeepSeek V3.277.4#403
8Qwen 3 235B A22B76.03#622
9Qwen 3 Coder Flash74.66#1624
10Claude Haiku 4.574.23#568
11Qwen 3 32B73.22#960
12Qwen 3 14B69.34#1235

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=citbench-base · How It Works · Data refreshed daily, snapshot 2026-11-12.