MI-CXR - Ordered Event Localization: leaderboard

Ordered Event Localization questions of MI-CXR (2026), five-option questions over five-visit chest X-ray timelines from MIMIC-CXR, answered zero-shot from all five images: locate an appearance followed by a resolution, or the reverse. Accuracy in percent (chance 20); higher is better.

Metric: Temporal Event Localization, ordered emergence-then-resolution or resolution-then-emergence patterns under exclusivity constraints, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (5,311 questions), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around 2034. 14 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-5.235.8#185
2MedGemma-4B30.1#2557
3IDEFICS2-8B29.1#5013
4Gemini 3 Pro (Preview)29#119
5MedGemma-27B-IT25.4#1350
6Claude Sonnet 4.524.3#261
7Qwen 3 VL 32B24#622
8InternVL3.5-38B22.4#1021
9InternVL3.5-14B22.3#1504
10Lingshu-32B21.4#1113
11MI-CXR DeepSeek-VL-16B (checkpoint unspecified)20
12InternVL3.5-8B19.3#1604
13Qwen 3 VL 8B18.5#917
14Lingshu-7B16.5#1635

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=mi-cxr-ordered-event-localization · How It Works · Data refreshed daily, snapshot 2026-11-21.