Oncology Report-Derived VQA - Brain MRI Report-Derived: leaderboard
Metric: Accuracy (%; zero-shot multiple-choice VQA with 2-5 options on one representative 2D slice of a 3D study, the model sees the image, question and options but never the report; invalid responses excluded; brain MRI, 480 cases (UCSF-PDGM images with private reports), 7,656 LLM-written questions checked against the report). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.6 | 68.1 |
| 2 | GPT-5 | 66.1 |
| 3 | GPT-5.2 | 63.5 |
| 4 | MedGemma-27B-IT | 61.3 |
Interactive version: theaggregate.ai/benchmark?slug=oncology-report-derived-vqa-brain-mri-report-derived · How It Works · Data refreshed daily, snapshot 2026-09-26.