CG-Bench - Open-Ended: leaderboard

CG-Bench open-ended question answering on long videos: free-form answers are judged by an LLM aided by the human-annotated clues, reported as accuracy (%); higher is better (Nanjing University and Shanghai AI Lab, 2024).

Metric: Open-Ended Accuracy (%). Source: cg-bench.github.io. Saturation forecast: Estimated already saturated. 22 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-08-06)39.2#731
2Claude 3.5 Sonnet35.6#747
3InternVL2.5-78B34.2#1018
4Qwen 2 VL 72B33.7#1130
5Gemini 1.5 Pro28.7#1053
6MiniCPM-V-2.626.3#3095
7GPT-4o Mini24.9#1627
8Gemini 1.5 Flash24.6#1671

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cg-bench-open-ended · How It Works · Data refreshed daily, snapshot 2026-11-12.