MedPIC-Bench - Counterfactual: leaderboard

Metric: Accuracy (%). Source: arxiv.org. 28 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)69.9
2GPT-563.4
3Qwen 3.5 Plus57.9
4GPT-OSS-120B56.8
5DeepSeek V4 Pro56.8
6Qwen 3.5 27B55.7
7Qwen 3.5 35B A3B54.6
8Lingshu-32B53
9GPT-5.252.5
10Claude Sonnet 4.648.1
11Qwen 3.5 9B48.1
12GPT-OSS-20B47.5
13Llama 3.1 70B47
14Gemini 2.5 Pro44.8
15Llama 3.1 8B33.3

Interactive version: theaggregate.ai/benchmark?slug=medpic-bench-counterfactual · How It Works · Data refreshed daily, snapshot 2026-09-19.