EPAG - Weighted HPI Guideline Score: leaderboard
EPAG pre-consultation (Seo et al., 2026): the model acts as a doctor agent asking five turns of multiple-choice history questions of a GPT-4o-mini patient agent, in Korean, over 520 patient profiles covering 26 diseases. The collected history of present illness is split into information units and matched against clinician-curated diagnostic guidelines, counting high-significance guideline items twice and medium ones once. Mean weighted matches per dialogue (an unbounded count); higher is better.
Metric: Guideline-Matched History Units per Dialogue (high=2, medium=1). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 | 8.12 | #492 |
| 2 | Claude 3.7 Sonnet | 8.12 | #455 |
| 3 | Claude 3.5 Sonnet | 8.05 | #747 |
| 4 | Claude 3.5 Haiku | 7.84 | #1563 |
| 5 | GPT-4o Mini | 7.75 | #1627 |
| 6 | GPT-4.1 Mini | 7.64 | #775 |
| 7 | GPT-4o | 7.59 | #741 |
| 8 | MedGemma-4B | 7.22 | #2460 |
| 9 | Phi-3.5-mini-instruct | 6.88 | #5757 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=epag-weighted-hpi-guideline-score · How It Works · Data refreshed daily, snapshot 2026-11-12.