PhysDox: leaderboard

Metric: Stage-1 severity-detection macro-F1 (0-100) on the 683-protocol expert-curated Gold set of biomedical physiological-sensing protocols (six domains): classify each protocol as valid, minor issue or fatal physical-feasibility violation; zero-shot prompting, temperature 0.1, JSON output with retries for malformed responses; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 6 models tracked.

Top models

#ModelScore
1Claude Opus 4.751.7
2DeepSeek V4 Flash45.8
3MiMo-V2.5-Pro45.6
4DeepSeek V4 Pro44.6
5MiMo-V2.543.9
6GPT-5.537.8

Interactive version: theaggregate.ai/benchmark?slug=physdox · How It Works · Data refreshed daily, snapshot 2026-09-29.