MoHallBench - Sequential Inference Hallucination: leaderboard

Metric: Q-PairAcc (%; share of adversarial pairs in which the model answers both the positive and the negative (reversed) yes/no query correctly; 32 uniformly sampled frames, temperature 0; sequential inference hallucination on clips truncated before the terminal sub-action). Source: arxiv.org. Saturation forecast: Around September 2028. 10 models tracked.

Top models

#ModelScore
1Qwen 3 VL 8B Instruct11.5
2Molmo2-8B11.1
3Qwen 2.5 VL 7B Instruct11
4Qwen 2 VL 7B Instruct7.1
5InternVL3-8B5.5

Interactive version: theaggregate.ai/benchmark?slug=mohallbench-sequential-inference-hallucination · How It Works · Data refreshed daily, snapshot 2026-09-29.