JevalKit - DecisionBench: leaderboard
JevalKit - DecisionBench. Native {"schema_version": 1, "name": "DecisionBench", "media_root": ".", "protocol": "standard-eval-systemone-native-v1", "reference_normalization": "sum-normalized only within 0.001 of one; original sum retained", "tie_break": "first upstream candidate; explicit mapping retained per question", "records": 23900, "questions": 23900, "sha256": "c99000b66862ef3781aa65f1d4edf267c605a519e619b9975a1509de428fefec", "family": "DecisionBench", "modality": "text", "module": "decision_bench", "source_url": "https://huggingface.co/datasets/Hanno-Labs/decision-bench"}. Complete, input-conformant, eligible primary runs with no runtime failures; text/vision Public Decision Index0-100, all other boards native accuracy fractions converted to percent. Calibration metrics retained separately; private composite components not represented as public. Metric: Accuracy (%). Higher is better.
Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 34 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Valen-Decision-1.5-27B | 84.13 | |
| 2 | Valen-Decision-1.5-9B | 83.34 | |
| 3 | Valen-Decision-1.5-4B | 83.33 | |
| 4 | StartLux-Decision-27B-Instant | 83.04 | |
| 5 | WeMM-JEV | 82.47 | |
| 6 | StartLux-v1.1-9B-Instant | 81.92 | |
| 7 | Valen-Decision-1.5-2B | 81.9 | |
| 8 | StartLux-v1.1-4B-Instant | 81.12 | |
| 9 | vLLM-SR-d3-turbo | 80.73 | |
| 10 | Valen-Decision-1.5-0.8B | 79.79 |
Interactive version: theaggregate.ai/benchmark?slug=jevalkit-decisionbench · How It Works · Data refreshed daily, snapshot 2026-11-13.