TrialDesignBench - D - Class-wise Macro-F1: leaderboard
TrialDesignBench v1,617trials, eightdesignclasses, inputconditionD. Acontext;Baddsattributes;Caddsdesignfactors;DworkflowoverB;EworkflowoverC. A-Cdirectclass;D/Edeterministictreewalk. AllE includes20correctedcombinationreruns. UnifiedDatabricksserving,claimedpinnedversions,deterministicdecoding; nativeClass-wise Macro-F1, no modelmean or crosscondition pooling.
Metric: Class-wise Macro-F1 (native). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | o3 (TrialDesignBench Run: endpoint=openai-gpt-o3;condition=D;serving=Databricks) | 0.38 | |
| 2 | GPT-5 (TrialDesignBench Run: endpoint=openai-gpt-5;condition=D;serving=Databricks) | 0.36 | |
| 3 | Claude Opus 5 (TrialDesignBench Run: endpoint=databricks-claude-opus-5;condition=D;serving=Databricks) | 0.27 | |
| 4 | Llama 4 Maverick (TrialDesignBench Run: endpoint=databricks-llama-4-maverick;condition=D;serving=Databricks) | 0.25 | |
| 5 | gpt-oss-120b (TrialDesignBench Run: endpoint=databricks-gpt-oss-120b;condition=D;serving=Databricks) | 0.22 |
Interactive version: theaggregate.ai/benchmark?slug=trialdesignbench-d-class-wise-macro-f1 · How It Works · Data refreshed daily, snapshot 2026-11-12.