JevalKit - JevAltBench: leaderboard
JevalKit - JevAltBench. Native {"schema_version": 1, "name": "JevAltBench", "media_root": ".", "protocol": "test-en-tr-de-explicit-unknown-v1", "reference_normalization": "sum-normalized only within 0.001 of one; original sum retained", "tie_break": "first upstream candidate; explicit mapping retained per question", "records": 3116, "questions": 8434, "sha256": "58cd34780da758315050609a716ea22e53519122513343327614d956ed08c49a", "family": "JevAltBench", "modality": "text", "module": "jevalt_bench", "source_url": "https://huggingface.co/datasets/mertkayacs/jevalt-bench"}. Complete, input-conformant, eligible primary runs with no runtime failures; text/vision Public Decision Index0-100, all other boards native accuracy fractions converted to percent. Calibration metrics retained separately; private composite components not represented as public. Metric: Accuracy (%). Higher is better.
Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 34 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Valen-Decision-1.5-27B | 95.22 | |
| 2 | StartLux-Decision-27B-Instant | 94.15 | |
| 3 | Valen-Decision-1.5-9B | 93.81 | |
| 4 | Valen-Decision-1.5-4B | 93.64 | |
| 5 | StartLux-v1.1-9B-Instant | 93.36 | |
| 6 | StartLux-v1.1-4B-Instant | 92.8 | |
| 7 | WeMM-JEV | 92.54 | |
| 8 | Perplexity Decider v1.1 | 92.25 | |
| 9 | Perplexity Decider v1.1 (Benchmark Sweep Run: source=JevalKit; native=Pplx-Decider%20%28L20Z%29; hardware=L20Z; checkpoint=pplx-decider-v1.1-27b) | 92.19 | |
| 10 | Amos-1-Large | 91.74 |
Interactive version: theaggregate.ai/benchmark?slug=jevalkit-jevaltbench · How It Works · Data refreshed daily, snapshot 2026-11-13.