MoHallBench - Action-Action Hallucination: leaderboard

Metric: Q-PairAcc (%; share of adversarial pairs in which the model answers both the positive and the negative (reversed) yes/no query correctly; 32 uniformly sampled frames, temperature 0; action-action transition hallucination on truncated clips). Source: arxiv.org. Saturation forecast: Around July 2027. 10 models tracked.

Top models

#ModelScore
1Qwen 3 VL 8B Instruct25.7
2Molmo2-8B24.4
3InternVL3-8B19.9
4Qwen 2 VL 7B Instruct15.5
5Qwen 2.5 VL 7B Instruct14.3

Interactive version: theaggregate.ai/benchmark?slug=mohallbench-action-action-hallucination · How It Works · Data refreshed daily, snapshot 2026-09-29.