SurgCoT - Causal Action Ordering: leaderboard

Metric: Causal action ordering main-question accuracy (%) on SurgCoT surgical-video multiple-choice questions (2,841 videos across 7 specialties and 35 procedures), baseline setting with only the video and the main question, zero-shot, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.592.81
2Gemini 2.5 Pro89.66
3GPT-585.07
4Qwen 2.5 VL 7B84.42
5MedGemma-27B-IT83.67

Interactive version: theaggregate.ai/benchmark?slug=surgcot-causal-action-ordering · How It Works · Data refreshed daily, snapshot 2026-10-07.