PersTurnBench - Dissatisfaction Rate: leaderboard

PersTurnBench (2026) replays turns of real users conversations: the candidate model writes the next assistant reply and a verified personalized evaluator with user memory predicts how satisfied that user would be, calibrated per user. This board is the share in percent of replayed turns predicted to leave the user neutral or dissatisfied; lower is better.

Metric: Dissatisfied-turn rate (%): share of replay turns with a calibrated satisfaction of 3 or lower, PersTurnBench replay of 300 turns from 90 users (180 user-task blocks): the candidate fills only the current assistant turn and the frozen Qwen3-8B memory evaluator predicts the user's turn satisfaction, reference-CDF calibrated per user; lower is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Kimi K2.61.3#192
2DeepSeek V4 Pro2.7#196
3GLM-5.12.7#198
4Claude Opus 4.74.7#85
5GPT-5.55.7#54
6Gemini 3.1 Pro (Preview)6#99
7Qwen 3 8B8#1873
8DeepSeek V4 Flash10.7#267
9Gemini 3.1 Flash Lite13#371
10MiniMax-M2.713.7#539

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=persturnbench-dissatisfaction-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.