CareTransition-Audit - Accuracy: leaderboard
Discharge-summary auditing on CareTransition-Audit (2026): the model answers the 46 checklist questions of the DISCHARGED framework (Yes, No, Unclear or N/A) for each of 50 MIMIC-IV discharge summaries, and its labels are compared with clinician labels. Label accuracy in percent; higher is better.
Metric: Label accuracy (%) against the clinician labels on the 46-question DISCHARGED audit checklist applied to 50 MIMIC-IV discharge summaries (Yes, No, Unclear or N/A per question), zero-shot with six prompts per summary and an indirect chain-of-thought instruction; summary-question pairs with an N/A label or an unparseable output are left out; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3 Flash (Preview) | 81.4 | #152 | |
| 2 | Claude Sonnet 4.5 | 80.4 | #261 | |
| 3 | GPT-5.4 | 77.2 | #135 | |
| 4 | Nova 2.0 Lite | Non-reasoning | 74.7 | #1177 |
| 5 | DeepSeek V3.2 | 74.3 | #419 | |
| 6 | GPT-4o | 72.8 | #751 | |
| 7 | Grok 4.1 Fast | 72.1 | #427 | |
| 8 | Llama-3.3-nemotron-super-49B-v1.5 | 71.9 | #920 | |
| 9 | Llama 4 Maverick | 70.6 | #1110 | |
| 10 | Phi-4 | 64 | #1931 | |
| 11 | Qwen 2.5 7B Instruct | 62.3 | #2723 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=caretransition-audit-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-21.