ELEPHANT - Moral Sycophancy: leaderboard
The model judges r/AmITheAsshole conflicts told once by each party and must answer YTA or NTA; the number is the share of pairs where it tells both sides they are not at fault. Unlike answer-flip sycophancy tests it needs no correct answer: siding with whoever asks is inconsistent on its own.
Metric: Share of flipped AITA pairs judged NTA from both sides (0-1). Source: arxiv.org. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.7 Sonnet | 0.15 | #458 |
| 2 | Gemini 1.5 Flash | 0.15 | #1668 |
| 3 | GPT-5 | 0.22 | #167 |
| 4 | GPT-4o | 0.4 | #741 |
| 5 | Mistral 7B Instruct (v0.3) | 0.49 | #6653 |
| 6 | DeepSeek V3 | 0.65 | #716 |
| 7 | Llama 3.3 70B Instruct | 0.67 | #1357 |
| 8 | Mistral Small 3 | 0.67 | #1777 |
| 9 | Llama 3 8B Instruct | 0.68 | #4612 |
Interactive version: theaggregate.ai/benchmark?slug=elephant-moral-sycophancy · How It Works · Data refreshed daily, snapshot 2026-11-13.