LifeSci Diamond (2026-11) - Plain API - Partial Credit: leaderboard
The November 3 LifeSci Diamond cohort has 55 regulatory affairs tasks, one saved answer per task, a common rubric and an LLM jury (Sonnet 5, GPT-5.6 Sol and Gemini 3.1 Pro Preview). Results combine earlier batches with six November additions. The exact scored task/rubric manifest is not public; 11 keys lack expert review. The three plain API models use the shared Vercel AI Gateway reference harness with Exa web search and up to 40 model steps. Effective provider defaults were not recorded. The published mean gives partial credit and is distinct from strict pass rate. Native rounded means are retained.
Metric: Mean partial-credit score (0-100). Source: www.arca.inc. Saturation forecast: Around February 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 83.3 | #6 |
| 2 | Claude Opus 5 | 78 | #16 |
| 3 | Claude Opus 5.5 | 77.4 | #3 |
No result here: #7 GPT-6.1 Sol, #9 Gemini 4 Argon, #10 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=lifesci-diamond-2026-11-plain-api-partial-credit · How It Works · Data refreshed daily, snapshot 2026-11-05.