SurgCoT - Causal Action Ordering: leaderboard

Determining the causal order of surgical micro-actions in surgical videos of SurgCoT (2026), multiple-choice questions over 2,841 videos from seven specialties, answered zero-shot with only the video and the main question. Main-question accuracy in percent; higher is better.

Metric: Causal action ordering main-question accuracy (%) on SurgCoT surgical-video multiple-choice questions (2,841 videos across 7 specialties and 35 procedures), baseline setting with only the video and the main question, zero-shot, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.592.81#267
2InternVL3.5-8B90.72#1618
3LLaVA-Med-7B89.95#6340
4Gemini 2.5 Pro89.66#280
5Qwen 3 VL 8B87.96#927
6Lingshu-7B86.68#1646
7GPT-585.07#185
8Qwen 2.5 VL 7B84.42#1878
9MedGemma-27B-IT83.67#1359
10HuatuoGPT-Vision-7B78.47#2178

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=surgcot-causal-action-ordering · How It Works · Data refreshed daily, snapshot 2026-11-22.