SurgCoT - Anomaly Onset Tracking: leaderboard

Localizing the onset and early course of surgical anomalies such as bleeding in surgical videos of SurgCoT (2026), multiple-choice questions over 2,841 videos from seven specialties, answered zero-shot with only the video and the main question. Main-question accuracy in percent; higher is better.

Metric: Anomaly onset tracking main-question accuracy (%) on SurgCoT surgical-video multiple-choice questions (2,841 videos across 7 specialties and 35 procedures), baseline setting with only the video and the main question, zero-shot, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around November 2027. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 8B79#917
2GPT-568.95#178
3HuatuoGPT-Vision-7B63.89#2162
4Qwen 2.5 VL 7B56.64#1862
5Claude Sonnet 4.554.74#261
6Gemini 2.5 Pro52.32#276
7InternVL3.5-8B51.46#1604
8MedGemma-27B-IT51.02#1350
9LLaVA-Med-7B50.97#6296
10Lingshu-7B50.46#1635

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=surgcot-anomaly-onset-tracking · How It Works · Data refreshed daily, snapshot 2026-11-21.