PersTurnBench - Dissatisfaction Rate: leaderboard

Metric: Dissatisfied-turn rate (%): share of replay turns with a calibrated satisfaction of 3 or lower, PersTurnBench replay of 300 turns from 90 users (180 user-task blocks): the candidate fills only the current assistant turn and the frozen Qwen3-8B memory evaluator predicts the user's turn satisfaction, reference-CDF calibrated per user; lower is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScore
1Kimi K2.61.3
2DeepSeek V4 Pro2.7
3GLM-5.12.7
4Claude Opus 4.74.7
5GPT-5.55.7
6Gemini 3.1 Pro (Preview)6
7Qwen 3 8B8
8DeepSeek V4 Flash10.7
9Gemini 3.1 Flash Lite13
10MiniMax-M2.713.7

Interactive version: theaggregate.ai/benchmark?slug=persturnbench-dissatisfaction-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.