DALPHIN (Contextual) - Open Questions: leaderboard
Case-specific free-response questions written by the contributing pathologists for 285 cases of the DALPHIN pathology copilot benchmark (Lems et al., 2026). Answers are compared with the reference answer by BioBERT semantic similarity; higher is better. Contextual scenario: each case's questions are asked in sequence within one conversation, so earlier answers stay in context.
Metric: BioBERT semantic similarity (biomedical sentence-embedding similarity, at most 1) of the uncurated free-text answer to the contributing pathologist's reference answer (285 case-specific free-response questions; contextual scenario: all questions of a case asked in sequence in one conversation). Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro (Medium) | 0.64 | #262 (Gemini 2.5 Pro) |
| 2 | GPT-5 (Medium) | 0.62 | #163 (GPT-5) |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=dalphin-contextual-open-questions · How It Works · Data refreshed daily, snapshot 2026-11-12.