Possible or Definite - Patient-Friendly Revision: leaderboard

Possible or Definite? (2026) is a benchmark of 1,200 MIMIC-IV clinical documents with 9,184 annotated diagnostic uncertainty cues, testing whether LLM outputs keep the stated level of uncertainty. This board asks for a patient-friendly rewrite under a baseline prompt and scores the uncertainty retained rate: among diagnoses the output keeps, the percent whose uncertainty level matches the source. Higher is better.

Metric: Uncertainty retained rate (%) on patient-friendly revision of the 1,200 benchmark clinical documents (MIMIC-IV notes, 9,184 cue-target annotations over five uncertainty levels) under the baseline prompt: among diagnostic targets the output keeps, the share whose uncertainty level (certain absent, probable, possible, indeterminate, non-asserted) matches the source; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash38.98#453
2GPT-OSS-120B37.77#700
3Claude Haiku 4.533.64#568

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=possible-or-definite-patient-friendly-revision · How It Works · Data refreshed daily, snapshot 2026-11-13.