MedConceal (Adaptive) - Confirmation Reveal Rate: leaderboard

Metric: Reveal rate (0-1, times 100): share of the gold hidden concerns the patient simulator reveals during the dialogue, Task 1 (confirmation), an adaptive confirmation policy in which the model decides when to stop, capped at 20 turns, over MedConceal's 300 clinician-reviewed cases built from r/AskDocs threads, in dialogue with a reserved, stateful patient simulator that reveals hidden psychosocial concerns only under clinically meaningful elicitation; higher is better. Source: arxiv.org. Saturation forecast: Around November 2027. 5 models tracked.

Top models

#ModelScore
1Qwen 3.5 9B93.4
2Claude Sonnet 4.554.2
3GPT-5.225.2

Interactive version: theaggregate.ai/benchmark?slug=medconceal-adaptive-confirmation-reveal-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.