MI-CXR - ICR Variant: leaderboard
ICR Variant questions of MI-CXR (2026), five-option questions over five-visit chest X-ray timelines from MIMIC-CXR, answered zero-shot from all five images: name the type of change between two given visits. Accuracy in percent (chance 20); higher is better.
Metric: Interval-wise Change Reasoning variant in which the pair of visits is specified and only the change type (new, resolved, progressed and similar) is asked, single abnormality, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (400 questions in this variant), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 | 76.5 | #185 |
| 2 | Gemini 3 Pro (Preview) | 74.3 | #119 |
| 3 | MedGemma-27B-IT | 70.5 | #1350 |
| 4 | Lingshu-32B | 70.5 | #1113 |
| 5 | InternVL3.5-8B | 66.7 | #1604 |
| 6 | InternVL3.5-14B | 66.1 | #1504 |
| 7 | InternVL3.5-38B | 63.4 | #1021 |
| 8 | MedGemma-4B | 61.7 | #2557 |
| 9 | Claude Sonnet 4.5 | 60.1 | #261 |
| 10 | Qwen 3 VL 32B | 60.1 | #622 |
| 11 | Qwen 3 VL 8B | 59 | #917 |
| 12 | Lingshu-7B | 58.5 | #1635 |
| 13 | IDEFICS2-8B | 44.8 | #5013 |
| 14 | MI-CXR DeepSeek-VL-16B (checkpoint unspecified) | 28.4 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=mi-cxr-icr-variant · How It Works · Data refreshed daily, snapshot 2026-11-21.