SurgiQ - Critical Care and Emergency: leaderboard

Critical care and emergency surgery questions of SurgiQ (2026), a four-option surgical multiple-choice benchmark: accuracy in percent, reading the option label with the highest next-token probability, zero-shot. Higher is better.

Metric: Critical care and emergency surgery questions (590): accuracy (%) on SurgiQ's four-option surgical multiple-choice questions, zero-shot; the answer is the option label with the highest next-token log-probability (plain and space-prefixed labels), options shuffled once. Source: arxiv.org. Saturation forecast: Estimated already saturated. 35 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 72B68.14#1190
2Qwen 2.5 72B Instruct67.8#1092
3Qwen 2.5 32B64.92#1332
4GPT-OSS-120B64.41#700
5Ministral-3-14B-Reasoning-251262.88#1396
6Qwen 2.5 32B Instruct61.69#1215
7GPT-OSS-20B60.68#1147
8DeepSeek R1 Distill Qwen 32B59.83#1788
9Ministral-3-8B-Reasoning-251258.81#1983
10Ministral-3-8B-Instruct-251252.88#1858
11DeepSeek R1 Distill Qwen 14B51.69#2582
12Gemma 2 9B (IT)43.9#2262
13MedGemma-4B-IT43.22#2716
14Gemma 2 2B (IT)36.1#6876
15DeepSeek-R1-Distill-Qwen-7B35.42#7996

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=surgiq-critical-care-and-emergency · How It Works · Data refreshed daily, snapshot 2026-11-13.