NCP-Bench - Satisfied Commitments: leaderboard
Part of NCP-Bench (Ma et al., 2026): the share of the narrative commitments of each environment that a model-narrated interactive story has satisfied when the episode ends under an adversarial player. Percentage averaged over 100 environments; higher is better.
Metric: Satisfied commitments (%; share of the narrative commitments in the Satisfied state at termination, averaged over the environments; 100 movie-synopsis narrative environments, each with an initial fact ledger, reference trajectory and commitment set; the evaluated model narrates against an adversarial Gemini-2.5-Flash player, and Gemini-2.5-Flash auditors check every narrator response and end the episode at the first confirmed fact, commitment or player-input conflict, at 100 turns, or when every achievement commitment is met; temperature 0.6, top-p 0.95). Source: arxiv.org. Saturation forecast: Around 2031. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V3.2 | 13.42 | #406 |
| 2 | GPT-5.2 | 11.22 | #176 |
| 3 | GPT-4o Mini | 10.9 | #1623 |
| 4 | Qwen 3 235B A22B | 10.6 | #623 |
| 5 | Grok 4.1 Fast | 10.37 | #430 |
| 6 | Kimi K2.5 | 5.18 | #256 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=ncp-bench-satisfied-commitments · How It Works · Data refreshed daily, snapshot 2026-11-13.