LLMTabBench (64-Shot) - Classic Datasets: leaderboard

Metric: ROC-AUC (0-1; 64 labelled demonstrations; 24 classic OpenML and Kaggle binary classification datasets; generation mode, prompt with column names and task description; mean over datasets and five demonstration draws). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.

Top models

#ModelScore
1Qwen 3 14B0.8
2GPT-4o Mini0.79
3Qwen 3 8B0.79
4Qwen 3 1.7B0.72

Interactive version: theaggregate.ai/benchmark?slug=llmtabbench-64-shot-classic-datasets · How It Works · Data refreshed daily, snapshot 2026-09-26.