Appear2Meaning: leaderboard

Appear2Meaning (2026) tests whether vision-language models infer structured cultural metadata from an image of a museum object, over Getty and Metropolitan Museum objects from East Asia, the ancient Mediterranean, Europe and the Americas, judged against the museum records. Share of objects with every predicted field judged correct, in percent; higher is better.

Metric: Exact-match accuracy (%, times 100; every predicted metadata field judged correct) on the Appear2Meaning benchmark (750 Getty and Met museum objects, 50 per culture-type combination over four cultural regions and four object types; image-only input, structured JSON prediction; GPT-4.1-mini judge against the museum metadata); higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 9 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 32B Instruct2.9#607
2Qwen 3 VL 8B Instruct2.4#1043
3Qwen-VL-Max1.4#1402
4Qwen 3 VL Plus1.4#514
5Qwen3-VL-Flash1.4#734
6GPT-4.1 Mini1.3#799
7Claude Haiku 4.51.2#587
8Pixtral-12B0.9#2611
9GPT-5.4 Mini0.5#409

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=appear2meaning · How It Works · Data refreshed daily, snapshot 2026-11-22.