TrialDesignBench - B - Class-wise Kappa: leaderboard
TrialDesignBench v1,617trials, eightdesignclasses, inputconditionB. Acontext;Baddsattributes;Caddsdesignfactors;DworkflowoverB;EworkflowoverC. A-Cdirectclass;D/Edeterministictreewalk. AllE includes20correctedcombinationreruns. UnifiedDatabricksserving,claimedpinnedversions,deterministicdecoding; nativeClass-wise Kappa, no modelmean or crosscondition pooling.
Metric: Class-wise Kappa (native). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 4 Maverick (TrialDesignBench Run: endpoint=databricks-llama-4-maverick;condition=B;serving=Databricks) | 0.14 | |
| 2 | GPT-5 (TrialDesignBench Run: endpoint=openai-gpt-5;condition=B;serving=Databricks) | 0.14 | |
| 3 | Claude Opus 5 (TrialDesignBench Run: endpoint=databricks-claude-opus-5;condition=B;serving=Databricks) | 0.14 | |
| 4 | o3 (TrialDesignBench Run: endpoint=openai-gpt-o3;condition=B;serving=Databricks) | 0.14 | |
| 5 | gpt-oss-120b (TrialDesignBench Run: endpoint=databricks-gpt-oss-120b;condition=B;serving=Databricks) | 0.1 |
Interactive version: theaggregate.ai/benchmark?slug=trialdesignbench-b-class-wise-kappa · How It Works · Data refreshed daily, snapshot 2026-11-12.