MMOOC - Uncertain Spatial and Physical Context (Multiple Choice): leaderboard
Metric: Out-of-context score (%; mean of the refusal rate, the share of the Uncertain Spatial and Physical Context Multiple Choice questions, which the image and context cannot answer, that the model correctly declines, and refusal rationality, the mean 0-1 judge score of its abstention reasoning in steps of 0.25; judge scores averaged over GPT-5.6, Claude Opus 5 and DeepSeek-V4-Pro). Source: arxiv.org. Saturation forecast: Around July 2028. 18 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 4 31B | 88.75 |
| 2 | Gemma 4 26B | 85 |
| 3 | Ministral 3 14B | 75.5 |
| 4 | Qwen 3.5 27B | 69.25 |
| 5 | O1 | 68.25 |
| 6 | Qwen 3.5 122B A10B | 67.75 |
| 7 | GPT-4o | 64.5 |
| 8 | Ministral 3 8B | 54.25 |
| 9 | Llama 4 Maverick | 47.25 |
| 10 | InternVL3-8B | 46.25 |
| 11 | O3 | 37.5 |
| 12 | Claude Opus 4.6 | 31.75 |
| 13 | Gemini 3.1 Pro (Preview) | 24.25 |
Interactive version: theaggregate.ai/benchmark?slug=mmooc-uncertain-spatial-and-physical-context-multiple-choice · How It Works · Data refreshed daily, snapshot 2026-09-29.