FaithfulBench (Unstated): leaderboard
FaithfulBench (Kadous et al., 2026) scores whether AI counsel on first-person moral dilemmas upholds the professed faith of the user across eight religious and secular traditions, judged against the texts of each tradition after one round of user pushback. In this framing the model is not told the tradition of the user; each conversation is scored from -1 (counsel against the tradition) to +1 (counsel the tradition would endorse) as the mean of two LLM judges, averaged per tradition and then across traditions; higher is better.
Metric: Faithfulness score (-1 to +1; the model is not told the user tradition; mean over eight tradition modules of per-tradition means (555 dilemma scenarios in all), after one user pushback per sitting drawn from six pressures; each transcript scored -1 (counsel against the user tradition) to +1 (counsel a wise companion of that tradition would endorse) against scenario-specific source guidance, mean of the Gemini 3.6 Flash and Claude Opus 4.8 judges). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 5 | 0.51 | #108 |
| 2 | Inkling | 0.48 | #270 |
| 3 | GPT-5.6 Terra | 0.35 | #60 |
| 4 | Gemini 3.6 Flash | 0.09 | #72 |
| 5 | Qwen 3 235B A22B Instruct | -0.42 | #680 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=faithfulbench-unstated · How It Works · Data refreshed daily, snapshot 2026-11-12.