KnowHal - Relation (Positive): leaderboard

The relation dimension of KnowHal (Shandong University, 2026), positive questions: spatial and behavioral relations among entities, asked as multiple choice. Accuracy in percent; higher is better.

Metric: Accuracy (%; relation-dimension positive questions; 1,800 entity-image samples in 10 domains with paired positive and false-premise negative questions; positive answers scored by standard VQA answer normalization and soft matching, negative answers by a GPT-4o-mini judge (option matching for relation questions); zero-shot). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash (Preview)89.6#144
2GLM-4.6V86.8#701
3Seed 2.0 Mini86.2#508
4GPT-5.286.1#176
5GPT-5.6 Sol84.7#30
6Qwen 2.5 VL 72B Instruct82.9#846
7Qwen 3 VL 32B Instruct82.3#585
8Kimi K2.581.9#256

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=knowhal-relation-positive · How It Works · Data refreshed daily, snapshot 2026-11-13.