CareTransition-Audit - Accuracy: leaderboard

Discharge-summary auditing on CareTransition-Audit (2026): the model answers the 46 checklist questions of the DISCHARGED framework (Yes, No, Unclear or N/A) for each of 50 MIMIC-IV discharge summaries, and its labels are compared with clinician labels. Label accuracy in percent; higher is better.

Metric: Label accuracy (%) against the clinician labels on the 46-question DISCHARGED audit checklist applied to 50 MIMIC-IV discharge summaries (Yes, No, Unclear or N/A per question), zero-shot with six prompts per summary and an indirect chain-of-thought instruction; summary-question pairs with an N/A label or an unparseable output are left out; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 Flash (Preview)81.4#152
2Claude Sonnet 4.580.4#261
3GPT-5.477.2#135
4Nova 2.0 LiteNon-reasoning74.7#1177
5DeepSeek V3.274.3#419
6GPT-4o72.8#751
7Grok 4.1 Fast72.1#427
8Llama-3.3-nemotron-super-49B-v1.571.9#920
9Llama 4 Maverick70.6#1110
10Phi-464#1931
11Qwen 2.5 7B Instruct62.3#2723

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=caretransition-audit-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-21.