TrialDesignBench - D - Class-wise Kappa: leaderboard
TrialDesignBench v1,617trials, eightdesignclasses, inputconditionD. Acontext;Baddsattributes;Caddsdesignfactors;DworkflowoverB;EworkflowoverC. A-Cdirectclass;D/Edeterministictreewalk. AllE includes20correctedcombinationreruns. UnifiedDatabricksserving,claimedpinnedversions,deterministicdecoding; nativeClass-wise Kappa, no modelmean or crosscondition pooling.
Metric: Class-wise Kappa (native). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 4 Maverick (TrialDesignBench Run: endpoint=databricks-llama-4-maverick;condition=D;serving=Databricks) | 0.39 | |
| 2 | Claude Opus 5 (TrialDesignBench Run: endpoint=databricks-claude-opus-5;condition=D;serving=Databricks) | 0.38 | |
| 3 | GPT-5 (TrialDesignBench Run: endpoint=openai-gpt-5;condition=D;serving=Databricks) | 0.2 | |
| 4 | o3 (TrialDesignBench Run: endpoint=openai-gpt-o3;condition=D;serving=Databricks) | 0.19 | |
| 5 | gpt-oss-120b (TrialDesignBench Run: endpoint=databricks-gpt-oss-120b;condition=D;serving=Databricks) | 0.19 |
Interactive version: theaggregate.ai/benchmark?slug=trialdesignbench-d-class-wise-kappa · How It Works · Data refreshed daily, snapshot 2026-11-12.