Why LLMs Fail at Causal Discovery and How Interventional Agents Escape: leaderboard

A text-based benchmark on causal discovery using Corr2Cause and Extended Corr2Cause, where models infer causal graphs from observational and interventional information. The evaluated method uses a frozen language model as an interventional oracle within an external Bayesian loop. The pinned metric is F1, measuring graph-prediction quality. Source: BenchmarkList’s attributed result table.

Metric: F1 (%). Source: benchmarklist.com. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.193.2#109
2Qwen 3 30B A3B92.1#496
3Qwen 3.5 122B A10B87.1#184
4Llama 3.3 70B85.7#578
5Gemma 3 12B77.6#674
6LLaMA-7B72.6#1543
7GPT-429.1#459

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=why-llms-fail-at-causal-discovery-and-how-interventional-agents-escape · How It Works · Data refreshed daily, snapshot 2026-11-05.