Possible or Definite - Handoff Summarization: leaderboard

Metric: Uncertainty retained rate (%) on clinician handoff summarization of the 1,200 benchmark clinical documents (MIMIC-IV notes, 9,184 cue-target annotations over five uncertainty levels) under the baseline prompt: among diagnostic targets the output keeps, the share whose uncertainty level (certain absent, probable, possible, indeterminate, non-asserted) matches the source; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 3 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash45.55
2GPT-OSS-120B44.36
3Claude Haiku 4.543.32

Interactive version: theaggregate.ai/benchmark?slug=possible-or-definite-handoff-summarization · How It Works · Data refreshed daily, snapshot 2026-09-29.