MMDM - Score nMAE: leaderboard
MMDM - Score nMAE: Valid-native-response error. MMDM arXiv 2611.14309v1: author-run decision-head or single-decoding-step models, no generated reasoning/adaptive thinking. Hard accuracy counts failed requests and boundary ties wrong. Native option caps/context differ by model and are pinned in Table A5. Soft Brier (0-2) and score normalized MAE (0-1) are valid-native-response errors, not full-cohort accuracy. Model-specific SB-F from Table 2 is withheld in favor of Table A10 fixed common 284-native-question SB-F (0-1). Source-native released artifact and service version identities remain distinct.
Metric: Valid-native-response error. Source: arxiv.org. Saturation forecast: Around February 2027. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Luna | 0.16 | #93 |
| 2 | JEV-27B-VL | 0.21 | #219 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mmdm-score-nmae · How It Works · Data refreshed daily, snapshot 2026-11-12.