LingxiDiagBench (Dynamic, Clinical, APA-Guided + MRD-RAG) - Consultation Quality: leaderboard

Metric: Consultation quality (1-6): mean of five Likert dimensions (clinical accuracy and competence, ethical and professional conduct, assessment and response, therapeutic relationship, communication quality), each the mean of three LLM judges (Gemma-3-27B, GPT-OSS-20B, Qwen3-30B-A3B); LingxiDiagBench-Dynamic on LingxiDiag-Clinical cases: the model leads a multi-turn consultation with a patient agent role-playing the real EMR and dialogue, then diagnoses; doctor strategy: the APA-guided interview with MRD-RAG retrieval of diagnostic guidelines for the top-3 suspected diagnoses; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScoreOverall rank
1GPT-OSS-20B4.09#499
2Qwen 3 32B3.87#424
3Qwen 3 4B3.27#823
4Qwen 3 8B3.1#667
5Qwen 3 1.7B2.11#1186

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=lingxidiagbench-dynamic-clinical-apa-guided-plus-mrd-rag-consultation-quality · How It Works · Data refreshed daily, snapshot 2026-10-11.