GPAgentBench-2K - Missed Referral Rate: leaderboard

GPAgentBench-2K (Chen et al., 2026) runs LLMs zero-shot as general practitioners in interactive consultations with a simulated patient, built from 2,428 physician-validated primary-care cases and six clinical actions. Percentage of referral-required cases the agent managed locally, a safety failure; lower is better.

Metric: Missed referral rate (%; referral-required cases the agent managed locally, a safety failure; lower is better; zero-shot GP agent with six clinical actions over 2,428 physician-validated primary-care cases, GPT-4o-mini patient simulator, at most 10 turns). Source: arxiv.org. Saturation forecast: Around May 2027. 21 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.640.3#173
2Gemini 3.1 Pro (Preview)47.8#91
3DeepSeek V4 Flash49.3#254
4GPT-5.451.2#121
5GLM-5.151.2#175
6DeepSeek V4 Pro57.2#181
7MiMo-V2.5-Pro59.2#274
8Qwen 3.7 Max64.7#142
9Claude Opus 4.767.2#75
10Claude Sonnet 4.677.1#158
11MiniMax-M2.778.1#519

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=gpagentbench-2k-missed-referral-rate · How It Works · Data refreshed daily, snapshot 2026-11-12.