LLMTabBench (32-Shot) - Classic Datasets: leaderboard
LLMTabBench (Grushina et al., 2026) tests LLMs as in-context binary classifiers of serialized table rows, prompted with the task description and column names and answering by generating a label. This board covers the 24 classic OpenML and Kaggle datasets in eight knowledge domains with 32 labelled example rows in the prompt, averaged over five draws of the examples; ROC-AUC from 0 to 1 averaged over datasets, higher is better.
Metric: ROC-AUC (0-1; 32 labelled demonstrations; 24 classic OpenML and Kaggle binary classification datasets; generation mode, prompt with column names and task description; mean over datasets and five demonstration draws). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 14B | 0.79 | #1235 |
| 2 | Qwen 3 8B | 0.79 | #1838 |
| 3 | GPT-4o Mini | 0.79 | #1627 |
| 4 | Qwen 3 1.7B | 0.7 | #5551 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=llmtabbench-32-shot-classic-datasets · How It Works · Data refreshed daily, snapshot 2026-11-12.