Oncology Report-Derived VQA - Brain MRI Report-Derived: leaderboard
Zero-shot multiple-choice visual question answering on brain MRI of confirmed cancer patients (UCSF-PDGM images paired with private institutional reports), with questions written by an LLM from each report's findings and impression and checked against the report (Liu et al., 2026). The model sees one representative slice with the question and options, never the report. Accuracy in percent over valid responses; higher is better.
Metric: Accuracy (%; zero-shot multiple-choice VQA with 2-5 options on one representative 2D slice of a 3D study, the model sees the image, question and options but never the report; invalid responses excluded; brain MRI, 480 cases (UCSF-PDGM images with private reports), 7,656 LLM-written questions checked against the report). Source: arxiv.org. Saturation forecast: Around August 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 68.1 | #100 |
| 2 | GPT-5 | 66.1 | #163 |
| 3 | GPT-5.2 | 63.5 | #172 |
| 4 | MedGemma 1.5 4B | 52.3 | #2579 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=oncology-report-derived-vqa-brain-mri-report-derived · How It Works · Data refreshed daily, snapshot 2026-11-12.