MedFlowBench (Radiology) - Task: leaderboard

Metric: Task score (0-1, shown times 100) before any evidence check (accuracy, or the share of the five labels right for lung PET/CT), averaged without weights over the three radiology modules (LUMIERE longitudinal brain MRI (139 questions: RANO response category from baseline and follow-up studies); UCSF-PDGM multi-sequence brain MRI (495 cases: tumor diagnosis); NSCLC lung PET/CT (162 cases: tumor location, pathological T and N stage, histology and grade)); the model drives 3D Slicer through the MedOpenClaw runtime with viewer-native actions only (series selection, scrolling, windowing, prealigned fusion), inspecting the complete study within a 20-round budget and returning an answer with structured evidence (Track A); higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 14 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)53#54
2GPT-5.553#26
3Gemini 3 Flash (Preview)47#78
4Qwen 3.5 35B A3B40#250
5Qwen 3.5 27B37#183
6Claude Opus 4.736#45
7Gemma 3 27B (IT)33#509
8Claude Sonnet 4.632#85
9GPT-5.4 Mini31#202
10MedGemma 1.5 4B26#775
11Qwen 3.5 4B25#470
12Qwen 3.5 9B23#363

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=medflowbench-radiology-task · How It Works · Data refreshed daily, snapshot 2026-10-11.