MeniOmni - Severe Error Rate: leaderboard
MeniOmni (2026) meniscus grading safety: the percent of knee MRI cases where a zero-shot multimodal model grades either meniscus two or more Stoller grades away from the radiologists. Lower is better.
Metric: Severe error rate (SER, %): share of cases where either compartment is graded two or more grades away from the radiologists, zero-shot Stoller grading (0 to 3) of the medial and lateral meniscus from sagittal, coronal and axial knee MRI sequences plus serialized age, sex and BMI, on the held-out test split (about a tenth of 746 cases from three centres, patient-level split), temperature 0; lower is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 12.4 | #751 |
| 2 | Claude 3.5 Sonnet | 13.8 | #752 |
| 3 | Gemini 1.5 Pro | 15.2 | #1063 |
| 4 | Qwen 2 VL 72B | 17.8 | #1134 |
| 5 | MeniOmni InternVL2 (checkpoint unspecified) | 20.5 | |
| 6 | Video-LLaVA-7B | 35.4 | #3879 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=meniomni-severe-error-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.