MeniOmni - Severe Error Rate: leaderboard

MeniOmni (2026) meniscus grading safety: the percent of knee MRI cases where a zero-shot multimodal model grades either meniscus two or more Stoller grades away from the radiologists. Lower is better.

Metric: Severe error rate (SER, %): share of cases where either compartment is graded two or more grades away from the radiologists, zero-shot Stoller grading (0 to 3) of the medial and lateral meniscus from sagittal, coronal and axial knee MRI sequences plus serialized age, sex and BMI, on the held-out test split (about a tenth of 746 cases from three centres, patient-level split), temperature 0; lower is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-4o12.4#751
2Claude 3.5 Sonnet13.8#752
3Gemini 1.5 Pro15.2#1063
4Qwen 2 VL 72B17.8#1134
5MeniOmni InternVL2 (checkpoint unspecified)20.5
6Video-LLaVA-7B35.4#3879

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=meniomni-severe-error-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.