LingxiDiagBench (Static, Clinical): leaderboard

Metric: Overall score (times 100, 0-100): mean of the eleven printed classification metrics (accuracy, macro-F1 and weighted F1 of the 2-class and 4-class tasks; accuracy, top-1 and top-3 accuracy, macro-F1 and weighted F1 of the 12-class task); LingxiDiagBench-Static on LingxiDiag-Clinical (real, de-identified Shanghai Mental Health Center outpatient consultations with clinician diagnoses): zero-shot diagnosis from the complete transcribed dialogue; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 6 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 32B54.8#424
2Qwen 3 4B54.4#823
3Qwen 3 1.7B53.2#1186
4Qwen 3 8B52.9#667
5GPT-OSS-20B27.9#499

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=lingxidiagbench-static-clinical · How It Works · Data refreshed daily, snapshot 2026-10-11.