MIBench-mini (Multimodal Interaction): leaderboard

Metric: Overall accuracy (%) on MIBench-mini, the paper's subset on which the closed-source models were also evaluated (multiple-choice image-text tasks; vision- and text-centric samples average several context variations); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 29 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)79.97#64
2Gemini 2.5 Pro76.6#145
3O3 (2025-04-16)73.53#117
4GPT-5.1 (2025-11-13)72.73#97
5GPT-5.271.6#105
6Claude Sonnet 4.570.8#138
7Qwen 3 VL 235B A22B Instruct66.67#264
8Qwen 2.5 VL 72B Instruct63.87#364
9GPT-4o (2024-11-20)62.2#369
10Qwen 2.5 VL 32B Instruct60.67#443
11Qwen 3 VL 8B Instruct58.53#401
12InternVL3-8B56.47#606
13Qwen 2 VL 7B Instruct55.4#816
14Qwen 2.5 VL 7B Instruct54.67#643
15InternVL2-8B51.2#826

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=mibench-mini-multimodal-interaction · How It Works · Data refreshed daily, snapshot 2026-10-11.