DDx-TRACE - Essential Evidence Recall: leaderboard

Metric: Essential-evidence recall (0-1): share of the physician-labelled essential imaging exams the model requested on DDx-TRACE (211 physician-adjudicated multimodal neuroradiology cases), the model starts from limited history, requests imaging in free form (at most 6 requests), updates a four-item probabilistic differential after each turn and stops with a localized diagnosis, provider default decoding; endpoints judged against case rubrics by Gemini 3 Flash at temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 13 models tracked.

Top models

#ModelScore
1Gemini 3 Flash0.77
2Gemini 3.1 Pro (Preview)0.72
3GPT-5.40.72
4Claude Sonnet 4.60.71
5Qwen 3.5 27B0.6
6Lingshu-32B0.6
7MedGemma-27B-IT0.58
8Qwen 3.5 4B0.54
9Qwen 3.5 9B0.53
10Gemma 3 27B0.51
11Qwen 3.5 35B A3B0.43
12GPT-5.4 Mini0.43
13MedGemma 1.5 4B0.26

Interactive version: theaggregate.ai/benchmark?slug=ddx-trace-essential-evidence-recall · How It Works · Data refreshed daily, snapshot 2026-10-07.