MI-CXR - Interval-wise Change Reasoning: leaderboard

Metric: Interval-wise Change Reasoning: find the interval matching a described change, with the interval not given, and interpret it, five-option multiple-choice accuracy (%, times 100; chance 20) on MI-CXR, longitudinal reasoning over five-visit chest X-ray timelines from MIMIC-CXR (5,311 questions), zero-shot single-step prompting with all five images, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around March 2028. 14 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)45.7
2Claude Sonnet 4.544.2
3GPT-5.243.8
4MedGemma-27B-IT42.9
5MedGemma-4B28.1
6Lingshu-32B16.7

Interactive version: theaggregate.ai/benchmark?slug=mi-cxr-interval-wise-change-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-07.