PatientAgentBench - Workflow Accuracy: leaderboard

The healthcare workflow accuracy rubric of PatientAgentBench (2026): the mean 1 to 5 jury score for correct, efficient and protocol-adherent tool calls with patient confirmation across 1,200 simulated patient conversations. Higher is better.

Metric: Mean workflow accuracy rubric score (1-5); 1,200 synthetic patient conversations of up to 15 turns with a simulated patient, the model inside the benchmark's baseline ReAct agent harness with 15 healthcare sandbox tools; jury of Claude Opus 4.8 and GPT-5.5 judges scoring clinician-grounded rubrics on a 1 to 5 scale; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.44.44#123
2Claude Opus 4.84.41#56
3GPT-5.54.32#49
4Claude Sonnet 54.28#111
5Claude Haiku 4.54.02#568
6Gemini 3.1 Pro (Preview)3.95#94
7Gemini 3 Flash3.72#164
8GPT-OSS-120B3.36#700
9Qwen 3 235B A22B3.3#623
10Qwen3-Next-80B2.98#626

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=patientagentbench-workflow-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-13.