MI-CXR - ICR Variant: leaderboard

Metric: Interval-wise Change Reasoning variant in which the pair of visits is specified and only the change type (new, resolved, progressed and similar) is asked, single abnormality, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (5,311 questions), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 14 models tracked.

Top models

#ModelScore
1GPT-5.276.5
2Gemini 3 Pro (Preview)74.3
3MedGemma-27B-IT70.5
4Lingshu-32B70.5
5MedGemma-4B61.7
6Claude Sonnet 4.560.1

Interactive version: theaggregate.ai/benchmark?slug=mi-cxr-icr-variant · How It Works · Data refreshed daily, snapshot 2026-10-07.