MIRAGE: leaderboard

Five years after the discovery of persistent anti-Muslim bias in large language models, most evaluations remain confined to single-turn prompt completion, a setting that no longer reflects how frontier LLMs are deployed. We introduce MIRAGE (Muslim-Identity Reasoning and Agentic Generation Evaluation), a benchmark of 1,200 prompts spanning three deployment-realistic conditions: direct

Metric: Violent completion rate, $C_1$ (%) (self-reported). Source: benchmarklist.com. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 48#163
2GPT-4o12#343
3Mistral Large19#710
4Qwen 2.5 72B22#499
5Llama 3.3 70B24#579
6DeepSeek V326#321

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mirage · How It Works · Data refreshed daily, snapshot 2026-10-20.