VideoHallucer: leaderboard
Video-language models answer yes/no questions on 948 videos in 1,000 pairs of a basic question and a hallucinated one, 200 pairs in each of five settings (object-relation, temporal, semantic detail, extrinsic factual, extrinsic non-factual); a pair counts only when both answers are right (1,800 distinct questions, since the two extrinsic settings share their basic questions). Scores are the paper's June 2024 runs on the original question set; in October 2025 the maintainers removed duplicate temporal questions, so the current release differs. Unlike image hallucination probes such as POPE, it tests videos and hallucinations that contradict world knowledge.
Metric: Overall pair accuracy over five hallucination settings (%). Source: arxiv.org. Saturation forecast: Around February 2027. 16 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o (2024-05-13) | 53.3 | #735 |
| 2 | PLLaVA-34B | 45 | #2441 |
| 3 | PLLaVA-13B | 41.2 | #3282 |
| 4 | PLLaVA-7B | 38.1 | #5042 |
| 5 | LLaVA-NeXT-Video-DPO (34B) | 32.3 | #2485 |
| 6 | LLaVA-NeXT-Video-7B-DPO | 32 | #8526 |
| 7 | LLaMA-VID-13B | 29.2 | |
| 8 | MiniGPT4-Video-Mistral | 22.3 | |
| 9 | LLaMA-VID-7B | 21 | #5333 |
| 10 | Video-LaVIT-v1 | 18.9 | |
| 11 | Video-LLaVA-7B | 17.8 | #3875 |
| 12 | Video-LLaMA-2-7B | 10 | |
| 13 | VideoChat2-7B | 7.8 | |
| 14 | Video-ChatGPT | 6.4 | #6947 |
| 15 | Video-LLaMA-2-13B | 3.3 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=videohallucer · How It Works · Data refreshed daily, snapshot 2026-11-17.