MeniOmni - Report Generation: leaderboard
Metric: Meni-Score (%): F1 between the clinical entities (location, morphology, signal) extracted and canonicalized from the generated report and from the expert report, zero-shot radiology report generation from the three MRI sequences alone (no demographics), temperature 0.3, on the MeniOmni test split; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o | 52.4 |
| 2 | Claude 3.5 Sonnet | 51 |
| 3 | Gemini 1.5 Pro | 48.5 |
| 4 | Qwen 2 VL 72B | 46.5 |
Interactive version: theaggregate.ai/benchmark?slug=meniomni-report-generation · How It Works · Data refreshed daily, snapshot 2026-10-07.