PatientAgentBench - Clinical Safety: leaderboard

Metric: Mean clinical safety rubric score (1-5); 1,200 synthetic patient conversations of up to 15 turns with a simulated patient, the model inside the benchmark's baseline ReAct agent harness with 15 healthcare sandbox tools; jury of Claude Opus 4.8 and GPT-5.5 judges scoring clinician-grounded rubrics on a 1 to 5 scale; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 10 models tracked.

Top models

#ModelScore
1Claude Opus 4.84.18
2GPT-5.54.16
3Claude Sonnet 54.04
4GPT-5.44.02
5Gemini 3 Flash3.57
6Gemini 3.1 Pro (Preview)3.52
7Claude Haiku 4.53.43
8GPT-OSS-120B3.22
9Qwen 3 235B A22B3.18

Interactive version: theaggregate.ai/benchmark?slug=patientagentbench-clinical-safety · How It Works · Data refreshed daily, snapshot 2026-09-29.