CiteTrace - Suitability Failure Rate: leaderboard

Metric: Suitability failure rate (%; share of evaluable citations whose source type is rated 1-2 for the question's domain on the expert-validated 10x6 source-suitability matrix; gpt-4o-mini classifier; 11,200 Stack Exchange questions). Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScore
1GPT-57.98
2GPT-5 Mini14.25
3Grok 4.1 Fast (Reasoning)24.56
4Grok 4.1 Fast (Non-reasoning)24.79
5Sonar29.99
6Gemini 3.1 Pro (Preview)30.07
7Claude Haiku 4.530.07
8Claude Sonnet 4.631.65
9Gemini 3 Flash33.46

Interactive version: theaggregate.ai/benchmark?slug=citetrace-suitability-failure-rate · How It Works · Data refreshed daily, snapshot 2026-09-26.