AMVICC - MMVP Individual Accuracy - Presence of Specific Features: leaderboard

Metric: Individual accuracy (%; the 70 MMVP questions on 35 image pairs in the Presence of Specific Features category, free-form answers graded by GPT-4 against the authors' rubric). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScore
1Llama 3.2 90B Vision Instruct97.14
2Llama 4 Scout95.71
3GPT-4o91.43
4Llama 4 Maverick90
5Gemma 3 27B90
6Qwen 2.5 VL 72B Instruct90
7Gemini 2.5 Pro88.57
8pixtral-large-241188.57
9Claude Sonnet 487.14
10Claude Opus 4.187.14
11Grok 482.86

Interactive version: theaggregate.ai/benchmark?slug=amvicc-mmvp-individual-accuracy-presence-of-specific-features · How It Works · Data refreshed daily, snapshot 2026-09-29.