MI-CXR: leaderboard

Longitudinal chest X-ray reasoning on MI-CXR (2026), five-option questions over five-visit chest X-ray timelines from MIMIC-CXR, answered zero-shot from all five images: temporal event localization, interval-wise change reasoning and trajectory summarization. Overall accuracy over 5,311 questions. Accuracy in percent (chance 20); higher is better.

Metric: Overall accuracy over the TEL, ICR and GTS task families, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (5,311 questions), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around September 2028. 14 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1InternVL3.5-38B41.8#1021
2GPT-5.241.1#185
3Gemini 3 Pro (Preview)38.7#119
4InternVL3.5-8B35.8#1604
5Claude Sonnet 4.531.5#261
6MedGemma-27B-IT29.9#1350
7InternVL3.5-14B28.1#1504
8Qwen 3 VL 32B27.2#622
9Lingshu-32B24.7#1113
10IDEFICS2-8B24.5#5013
11MedGemma-4B23.7#2557
12Qwen 3 VL 8B23.4#917
13Lingshu-7B22.3#1635
14MI-CXR DeepSeek-VL-16B (checkpoint unspecified)18.1

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=mi-cxr · How It Works · Data refreshed daily, snapshot 2026-11-21.