MedFlowBench (Radiology) - Longitudinal MRI Strict: leaderboard

Metric: Strict score (0-1, shown times 100) on LUMIERE longitudinal brain MRI (139 questions: RANO response category from baseline and follow-up studies): the RANO category and every scorable follow-up lesion-state field (non-measurable lesion, T2 progression, current and new target and non-target lesions) must be right; the model drives 3D Slicer through the MedOpenClaw runtime with viewer-native actions only (series selection, scrolling, windowing, prealigned fusion), inspecting the complete study within a 20-round budget and returning an answer with structured evidence (Track A); higher is better. Source: arxiv.org. Saturation forecast: Around 2032. 14 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.718#45
2Qwen 3.5 35B A3B18#250
3Claude Sonnet 4.617#85
4Qwen 3.5 4B11#470
5Qwen 3.5 27B9#183
6Gemini 3.1 Pro (Preview)8#54
7Qwen 3.5 9B8#363
8Gemini 3 Flash (Preview)7#78
9GPT-5.4 Mini5#202
10GPT-5.54#26
11MedGemma 1.5 4B2#775
12Gemma 3 27B (IT)1#509

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=medflowbench-radiology-longitudinal-mri-strict · How It Works · Data refreshed daily, snapshot 2026-10-11.