DecideBench: leaderboard

Decision models pick one option key for each of 450 multiple-choice business decisions (agent action review, tool routing, moderation, refunds, release gating, triage), with one worked example per option for every model that can take one (three encoder models run zero-shot); the score is the share of the 450 items each model got right. Unlike general reasoning sets, the items were written so a frontier LLM solves almost all of them, so the board measures how close small dedicated decision models come to that.

Metric: Accuracy on 450 contrastive decisions (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 27 models tracked. Updated 16 Nov 2026.

Top models

#ModelScoreOverall rank
1Drex Max94.4
2REAX 1 27B92.4
3PPLX-Decider-v1.292.2
4vLLM-SR-d391.6
5Jev 1.14.088
6yev2-35B-a3B88
7yev2-35B-a3B [FP8]87.6
8Jev 1.13.086.2
9Clef 27B85.3
10Blink-v0.3-26B-A4B [NVFP4]82
11Drex v2.080.9
12yev1-4B79.3
13PPLX-Decider-Flash-v1.278.2
14yev0-4B78.2
15Nimble 9B75.6

Interactive version: theaggregate.ai/benchmark?slug=decidebench · How It Works · Data refreshed daily, snapshot 2026-11-16.