Colon-Bench - VQA (Unprompted): leaderboard

Metric: Accuracy (%) on Colon-Bench's 2,740 unprompted five-option video questions over 918 raw colonoscopy clips, lesion-free windows included; unanswered questions count as wrong; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro82.5#77
2Gemini 3 Flash76#93
3Seed-1.672#257
4GPT-5.271.4#105
5GPT-5.470.8#76
6Gemini 3.1 Flash Lite67.7#174
7Qwen 3.5 Plus60.5#123
8Qwen 3.5 397B A17B60.1#141
9Qwen 3 VL 235B A22B56.6#228
10GLM-4.6V53.8#309
11Molmo2-8B53.4#522
12Gemini 2.5 Flash Lite46.8#413
13Seed 1.6 Flash45.4#427

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=colon-bench-vqa-unprompted · How It Works · Data refreshed daily, snapshot 2026-10-11.