Prism-1 Decision Sets - Banking20: leaderboard
Prism-1 paper decision benchmark: single-choice decisions over 2 to 20 options read in one call without generated reasoning. Banking20: 300 test messages over 20 intents of a banking intent dataset. Only the models marked as published and not trained on the paper's data are published: the Jev 1.13 and Mercury Decide decision APIs and Torchcast Decision 12B (a published decision fine-tune of Gemma 4 12B). The SCQ, set-based and Prism-1 rows are methods fine-tuned on the paper's training splits and are omitted. Metric: Accuracy (%). Higher is better. Source: https://arxiv.org/html/2610.22066v1
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Mercury Decide | 91.3 | |
| 2 | Jev 1.13 | 87 | |
| 3 | Torchcast Decision 12B | 83.7 |
Interactive version: theaggregate.ai/benchmark?slug=prism-1-decision-sets-banking20 · How It Works · Data refreshed daily, snapshot 2026-10-18.