MoHallBench - Object-Action Hallucination: leaderboard

Metric: Q-PairAcc (%; share of adversarial pairs in which the model answers both the positive and the negative (reversed) yes/no query correctly; 32 uniformly sampled frames, temperature 0; object-action co-occurrence hallucination, Charades). Source: arxiv.org. Saturation forecast: Around December 2026. 10 models tracked.

Top models

#ModelScore
1Qwen 3 VL 8B Instruct33.1
2Molmo2-8B28.9
3InternVL3-8B27.9
4Qwen 2 VL 7B Instruct18.6
5Qwen 2.5 VL 7B Instruct17.3

Interactive version: theaggregate.ai/benchmark?slug=mohallbench-object-action-hallucination · How It Works · Data refreshed daily, snapshot 2026-09-29.