Prism-1 Decision Sets - Typed Decisions: leaderboard
Prism-1 paper decision benchmark: single-choice decisions over 2 to 20 options read in one call without generated reasoning. Typed Decisions: the 600 choice questions of its test split (4-5 options). Only the models marked as published and not trained on the paper's data are published: the Jev 1.13 and Mercury Decide decision APIs and Torchcast Decision 12B (a published decision fine-tune of Gemma 4 12B). The SCQ, set-based and Prism-1 rows are methods fine-tuned on the paper's training splits and are omitted. Metric: Accuracy (%). Higher is better. Source: https://arxiv.org/html/2610.22066v1
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Jev 1.13 | 72.8 | |
| 2 | Torchcast Decision 12B | 69 | |
| 3 | Mercury Decide | 67.3 |
Interactive version: theaggregate.ai/benchmark?slug=prism-1-decision-sets-typed-decisions · How It Works · Data refreshed daily, snapshot 2026-10-18.