Stick To Your Role!: leaderboard
Stick To Your Role! (Flowers team, Inria, 2024) has a model simulate a population of personas that answer the PVQ-40 and SVS value questionnaires after simulated conversations on different topics, and measures how stable and theory-consistent the expressed Schwartz values stay across contexts. The cardinal score averages rank-order stability over context pairs with validity metrics (CFA fit and MDS stress, lower-is-better ones inverted), on a -1 to 1 scale; higher is better.
Metric: Cardinal Score (-1 to 1). Source: huggingface.co. Saturation forecast: Estimated already saturated. 31 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 VL 72B Instruct | 0.84 | #845 |
| 2 | Llama 3.1 Nemotron 70B Instruct | 0.81 | #1447 |
| 3 | Mistral Large 2 (Jul) | 0.79 | #1153 |
| 4 | Llama 3.3 70B Instruct | 0.78 | #1353 |
| 5 | Llama 3.1 70B Instruct | 0.77 | #1541 |
| 6 | QwQ-32B | 0.77 | #909 |
| 7 | Qwen 3 32B | 0.74 | #960 |
| 8 | Mistral Large 2 (Nov) Instruct (2411) | 0.73 | #1199 |
| 9 | Qwen 3 8B | 0.72 | #1838 |
| 10 | Qwen 3 235B A22B FP8 | 0.72 | #533 |
| 11 | Mistral Small 3.1 | 0.7 | #1699 |
| 12 | Qwen2.5-14B-Instruct-1M | 0.7 | #1417 |
| 13 | Qwen 3 4B | 0.7 | #2297 |
| 14 | Llama 3.1 8B Instruct | 0.62 | #4277 |
| 15 | Llama 4 Scout Instruct | 0.62 | #1532 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=stick-to-your-role · How It Works · Data refreshed daily, snapshot 2026-11-12.