ClinTraceBench - Attribution Detection: leaderboard

ClinTraceBench (Wang, Zhao and Zhao, Findings of EMNLP 2026) tests longitudinal clinical reasoning over multi-visit patient-clinician dialogues derived from MIMIC-IV records; this task asks whether the record attributes a finding to a problem through a controlled physician-attribution sentence, present in half of the cases. Accuracy in percent over 600 questions with the whole dialogue history in context; higher is better.

Metric: Accuracy (%; task T3, controlled attribution detection: whether the dialogue attributes a finding to a problem, balanced yes/no, 600 questions; full-context strategy: the whole multi-visit patient-clinician dialogue derived from MIMIC-IV records is given verbatim, models called through OpenRouter). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V3.193.8#500
2GPT-4o Mini93.1#1627
3Claude Sonnet 4.688.5#158
4Claude Haiku 4.586.9#568

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=clintracebench-attribution-detection · How It Works · Data refreshed daily, snapshot 2026-11-12.