PhysDox - End-to-End Diagnosis: leaderboard

Metric: End-to-end Fine-12 accuracy (%) on the fatal-violation protocols of the 683-protocol expert-curated Gold set of biomedical physiological-sensing protocols (six domains): a protocol counts only if Stage 1 flags it as fatal and Stage 2 names the violated fine-grained constraint; zero-shot prompting, temperature 0.1, JSON output with retries for malformed responses; higher is better. Source: arxiv.org. Saturation forecast: Around March 2027. 6 models tracked.

Top models

#ModelScore
1GPT-5.552.5
2DeepSeek V4 Flash49.3
3Claude Opus 4.746.7
4DeepSeek V4 Pro39.3
5MiMo-V2.5-Pro27.6
6MiMo-V2.526

Interactive version: theaggregate.ai/benchmark?slug=physdox-end-to-end-diagnosis · How It Works · Data refreshed daily, snapshot 2026-09-29.