DeEscalWild - Realism (GPT-5.4 Judge): leaderboard

DeEscalWild (2026) civilian role-play over 150 real police-civilian interactions, with realism (behavioural plausibility, naturalness, persona adherence) scored 0-100 by a GPT-5.4 judge; higher is better.

Metric: Realism score (0-100) from a GPT-5.4 judge rating behavioural plausibility, linguistic naturalness and persona adherence of the generated civilian turns, on DeEscalWild's 150 held-out police-civilian interactions transcribed from real social-media footage: at each turn the model, prompted zero-shot with the situation and a civilian persona, receives the gold officer utterance and generates the civilian reply (autoregressive simulation); mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Llama 3.2 3B Instruct35.5#7311
2Qwen 2.5 3B Instruct34.8#5410
3granite-3.0-2B-instruct31.8#8277
4Falcon3-3B-Instruct29.6#8311
5Gemma 2 2B (IT)28.1#7062

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=deescalwild-realism-gpt-5-4-judge · How It Works · Data refreshed daily, snapshot 2026-11-22.