JevalKit - ProceduralTypedDecisions: leaderboard
JevalKit - ProceduralTypedDecisions. Native {"schema_version": 1, "name": "ProceduralTypedDecisions", "media_root": ".", "protocol": "18-tasks-test-native-probability-v1", "reference_normalization": "sum-normalized only within 0.001 of one; original sum retained", "tie_break": "first upstream candidate; explicit mapping retained per question", "records": 18000, "questions": 57016, "sha256": "4809d20dc7aa54a6d15d7edf352044e658898e46232cb42bba9acb15f1fd8faf", "family": "ProceduralTypedDecisions", "modality": "text", "module": "procedural_typed_decisions", "source_url": "https://huggingface.co/datasets/tasksource/procedural-typed-decisions"}. Complete, input-conformant, eligible primary runs with no runtime failures; text/vision Public Decision Index0-100, all other boards native accuracy fractions converted to percent. Calibration metrics retained separately; private composite components not represented as public. Metric: Accuracy (%). Higher is better.
Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 34 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Valen-Decision-1.5-27B | 97.19 | |
| 2 | WeMM-JEV | 96.55 | |
| 3 | Valen-Decision-1.5-9B | 95.71 | |
| 4 | Valen-Decision-1.5-4B | 95.57 | |
| 5 | vLLM-SR-d3-turbo | 95.11 | |
| 6 | Perplexity Decider v1.1 (Benchmark Sweep Run: source=JevalKit; native=Pplx-Decider%20%28L20Z%29; hardware=L20Z; checkpoint=pplx-decider-v1.1-27b) | 94.61 | |
| 7 | Perplexity Decider v1.1 | 94.59 | |
| 8 | StartLux-Decision-27B-Instant | 94.18 | |
| 9 | Amos-1-Large | 93.65 | |
| 10 | Valen-Decision-1.5-2B | 92.2 |
Interactive version: theaggregate.ai/benchmark?slug=jevalkit-proceduraltypeddecisions · How It Works · Data refreshed daily, snapshot 2026-11-13.