NCP-Bench - Trajectory Progress: leaderboard

Metric: Trajectory progress (%; share of the reference trajectory reached at termination, averaged over the environments; 100 movie-synopsis narrative environments, each with an initial fact ledger, reference trajectory and commitment set; the evaluated model narrates against an adversarial Gemini-2.5-Flash player, and Gemini-2.5-Flash auditors check every narrator response and end the episode at the first confirmed fact, commitment or player-input conflict, at 100 turns, or when every achievement commitment is met; temperature 0.6, top-p 0.95). Source: arxiv.org. Saturation forecast: Around 2032. 6 models tracked.

Top models

#ModelScore
1DeepSeek V3.215.4
2Qwen 3 235B A22B13.16
3Grok 4.1 Fast12.07
4GPT-4o Mini10.57
5Kimi K2.510.26
6GPT-5.29.94

Interactive version: theaggregate.ai/benchmark?slug=ncp-bench-trajectory-progress · How It Works · Data refreshed daily, snapshot 2026-09-29.