MoHallBench - Scene-Action Hallucination: leaderboard

Metric: Q-PairAcc (%; share of adversarial pairs in which the model answers both the positive and the negative (reversed) yes/no query correctly; 32 uniformly sampled frames, temperature 0; scene-action co-occurrence hallucination, Charades). Source: arxiv.org. Saturation forecast: Around December 2026. 10 models tracked.

Top models

#ModelScore
1Qwen 3 VL 8B Instruct53.6
2InternVL3-8B50.1
3Molmo2-8B49.9
4Qwen 2 VL 7B Instruct32.2
5Qwen 2.5 VL 7B Instruct26.3

Interactive version: theaggregate.ai/benchmark?slug=mohallbench-scene-action-hallucination · How It Works · Data refreshed daily, snapshot 2026-09-29.