OpenVLM SEEDBench IMG - Instance Attributes: leaderboard

SEED-Bench image Instance Attributes accuracy from the OpenCompass OpenVLM Leaderboard (VLMEvalKit): four-option multiple-choice questions on attributes of objects such as colour, shape and material, one of the nine evaluation dimensions of the SEED-Bench image set. Accuracy in percent, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 226 models tracked.

Top models

#ModelScoreOverall rank
1InternVL3-78B80.6#361
2InternVL3-38B80.4#413
3GPT-4.1 (2025-04-14)80.2#257
4GPT-4.1 Mini80#363
5Llama 3.2 90B Vision Instruct79.7#621
6InternVL3-14B79.4#506
7Qwen 2 VL 72B79#450
8Qwen 2.5 VL 7B79#641
9InternVL3-8B78.8#624
10Gemini 1.5 Flash78.3#620
11InternVL2-8B78.1#813
12Gemini 1.5 Pro78#454
13Qwen 2 VL 7B77.8#743
14Grok 2 (1212)77.5#502
15Llama 3.2 11B Instruct77#1108

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openvlm-seedbench-img-instance-attributes · How It Works · Data refreshed daily, snapshot 2026-11-05.