PRISM-BN - State F1: leaderboard
State enumeration in PRISM-BN (Bhattacharya et al., 2026): for every variable aligned with the reference network, how well the predicted states match the reference states. F1 in percent, macro-averaged over aligned variables and therefore conditional on node alignment; higher is better.
Metric: State F1 (%; macro-averaged over nodes matched in the node phase, so conditional on node alignment; zero-shot extraction of a parameterized Bayesian network from each of the 5,054 PRISM-BN text descriptions through the four-phase prompt pipeline; predicted node and state names are aligned one-to-one with the reference by a Llama 3.3 70B semantic judge). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Haiku 4.5 | 93.1 | #568 |
| 2 | DeepSeek V3 | 91.8 | #705 |
| 3 | Qwen 3 30B A3B 2507 Instruct | 90.7 | #1078 |
| 4 | GPT-4o Mini | 90.3 | #1627 |
| 5 | Gemma 3 12B (IT) | 89.3 | #1849 |
| 6 | Llama 4 Maverick | 88.6 | #1105 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=prism-bn-state-f1 · How It Works · Data refreshed daily, snapshot 2026-11-12.