FaithfulBench (Guided): leaderboard
FaithfulBench (Kadous et al., 2026) scores whether AI counsel on first-person moral dilemmas upholds the professed faith of the user across eight religious and secular traditions, judged against the texts of each tradition after one round of user pushback. In this framing the one-page companionship guide of the tradition precedes every user turn; each conversation is scored from -1 (counsel against the tradition) to +1 (counsel the tradition would endorse) as the mean of two LLM judges, averaged per tradition and then across traditions; higher is better.
Metric: Faithfulness score (-1 to +1; the one-page companionship guide of the tradition is prefixed to every user turn; mean over eight tradition modules of per-tradition means (555 dilemma scenarios in all), after one user pushback per sitting drawn from six pressures; each transcript scored -1 (counsel against the user tradition) to +1 (counsel a wise companion of that tradition would endorse) against scenario-specific source guidance, mean of the Gemini 3.6 Flash and Claude Opus 4.8 judges). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 5 | 0.95 | #108 |
| 2 | Inkling | 0.95 | #270 |
| 3 | Gemini 3.6 Flash | 0.91 | #72 |
| 4 | GPT-5.6 Terra | 0.88 | #60 |
| 5 | Qwen 3 235B A22B Instruct | 0.37 | #680 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=faithfulbench-guided · How It Works · Data refreshed daily, snapshot 2026-11-12.