When Symptoms Are Not Enough: leaderboard

As demand for mental health care outpaces clinician-delivered assessment, scalable screening tools are increasingly needed. Large language models (LLMs) may identify psychiatric risk from patient narratives, but their reliability across diagnoses, demographic subgroups, and evidence-use patterns remains uncertain. We introduce a SCID-anchored benchmark of 555 semi-structured experiential interview

Metric: Matthews correlation coefficient (self-reported). Source: benchmarklist.com. Saturation forecast: Around December 2026. 5 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4.1 Mini38#355
2GPT-5 Mini34#186
3GPT-4.130#248
4Gemini 2.5 Pro28#152
5Llama 4 Scout16#656

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=when-symptoms-are-not-enough · How It Works · Data refreshed daily, snapshot 2026-10-20.