MI-CXR - Single Event Localization: leaderboard

Metric: Temporal Event Localization, single emergence or resolution: identify the interval in which one abnormality appears or resolves, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (5,311 questions), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 14 models tracked.

Top models

#ModelScore
1GPT-5.233.4
2Gemini 3 Pro (Preview)24.6
3Claude Sonnet 4.522.6
4Lingshu-32B22.1
5MedGemma-27B-IT21.5
6MedGemma-4B17.4

Interactive version: theaggregate.ai/benchmark?slug=mi-cxr-single-event-localization · How It Works · Data refreshed daily, snapshot 2026-10-07.