PharmaBench - Regulatory Review - Mean Score: leaderboard
PharmaBench - Regulatory Review - Mean Score: Mean rubric score (%). PharmaBench: 120 tasks across eight synthetic drug programs, three runs per task, same unnamed open-source coding agent in an isolated shell/Python/document sandbox without internet. The original eleven-model report uses provider-default reasoning and an unnamed LLM rubric judge; late scoreboard top-up settings are not separately reported. Pass means every required criterion met and no penalty; mean is rubric reward averaged over runs then tasks. Group breakdowns retain the eleven-model report.
Metric: Mean rubric score (%). Source: www.micro1.ai. Saturation forecast: Rough model projection: around 2026. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Muse Wonder (PharmaBench Run: provider-default; coding-agent-unnamed) | 77.04 | |
| 2 | GPT-6 Astra (PharmaBench Run: provider-default; coding-agent-unnamed) | 75.74 | |
| 3 | Muse Spark 1.3 (PharmaBench Run: provider-default; coding-agent-unnamed) | 71.25 | |
| 4 | Claude Fable 5.1 (PharmaBench Run: provider-default; coding-agent-unnamed) | 68.92 | |
| 5 | Grok 4.6 (PharmaBench Run: provider-default; coding-agent-unnamed) | 68.7 | |
| 6 | Claude Sonnet 5.5 (PharmaBench Run: provider-default; coding-agent-unnamed) | 67.71 | |
| 7 | Claude Opus 5.5 (PharmaBench Run: provider-default; coding-agent-unnamed) | 65.66 | |
| 8 | Claude Opus 5 (PharmaBench Run: provider-default; coding-agent-unnamed) | 64.85 | |
| 9 | Gemini 4 Argon (PharmaBench Run: provider-default; coding-agent-unnamed) | 64.01 | |
| 10 | Muse Spark 1.1 (PharmaBench Run: provider-default; coding-agent-unnamed) | 61.7 |
Interactive version: theaggregate.ai/benchmark?slug=pharmabench-regulatory-review-mean-score · How It Works · Data refreshed daily, snapshot 2026-11-06.