TrialDesignBench - B - Class-wise Accuracy: leaderboard
TrialDesignBench v1,617trials, eightdesignclasses, inputconditionB. Acontext;Baddsattributes;Caddsdesignfactors;DworkflowoverB;EworkflowoverC. A-Cdirectclass;D/Edeterministictreewalk. AllE includes20correctedcombinationreruns. UnifiedDatabricksserving,claimedpinnedversions,deterministicdecoding; nativeClass-wise Accuracy, no modelmean or crosscondition pooling.
Metric: Class-wise Accuracy (native). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 4 Maverick (TrialDesignBench Run: endpoint=databricks-llama-4-maverick;condition=B;serving=Databricks) | 0.77 | |
| 2 | o3 (TrialDesignBench Run: endpoint=openai-gpt-o3;condition=B;serving=Databricks) | 0.6 | |
| 3 | Claude Opus 5 (TrialDesignBench Run: endpoint=databricks-claude-opus-5;condition=B;serving=Databricks) | 0.6 | |
| 4 | gpt-oss-120b (TrialDesignBench Run: endpoint=databricks-gpt-oss-120b;condition=B;serving=Databricks) | 0.55 | |
| 5 | GPT-5 (TrialDesignBench Run: endpoint=openai-gpt-5;condition=B;serving=Databricks) | 0.55 |
Interactive version: theaggregate.ai/benchmark?slug=trialdesignbench-b-class-wise-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-12.