LingxiDiagBench (Dynamic, Symptom-Tree) - 12-Class Accuracy: leaderboard

Metric: Accuracy (%, 0-100) on twelve-category ICD-10 diagnosis (F20, F31, F32, F39, F41, F42, F43, F45, F51, F98, Z71, others; multi-label, exact match of the predicted label set) after the consultation; LingxiDiagBench-Dynamic on LingxiDiag-16K cases: the model leads a multi-turn consultation with a Qwen3-32B patient agent built from the case EMR, then diagnoses; doctor strategy: the MDD-5K symptom decision-tree strategy; higher is better. Source: arxiv.org. Saturation forecast: Around November 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Grok 4.1 Fast26#208
2Claude Haiku 4.525#271
3DeepSeek V3.221.5#198
4Kimi K2 (Thinking)21.5#236 (Kimi K2)
5GPT-5 Mini20.5#176
6Qwen 3 32B16#424
7Gemini 3 Flash15#93
8GPT-OSS-20B12#499
9Qwen 3 1.7B7#1186
10Qwen 3 8B0.5#667
11Qwen 3 4B0.5#823

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=lingxidiagbench-dynamic-symptom-tree-12-class-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-11.