SMDD-Bench - 2D Pharmacophore Identification: leaderboard
Success rate (%) on the 25 tasks that ask for the 2D pharmacophore of a ligand series in SMDD-Bench (2026), where LLM agents with a minimal tool harness and a limited budget of Boltz-2 structure and ADMET-AI property oracles must submit molecules that pass hidden evaluators. Higher is better.
Metric: Success rate (%) on the 25 SMDD-Bench 2D pharmacophore identification tasks, minimalist ReAct agent harness with RDKit-style tools, 8 Boltz-2 and 15 ADMET-AI oracle calls per task, temperature 1.0, at most 100 turns; success means the submitted Python pharmacophore function passes recall and specificity checks on hidden active and inactive molecules; higher is better. Source: arxiv.org. Saturation forecast: Around September 2028. 7 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 28 | #173 | |
| 2 | Gemini 3.1 Pro (Preview) | Medium | 20 | #99 |
| 3 | MiniMax-M2.7 | 16 | #539 | |
| 4 | Kimi K2.5 | Thinking | 12 | #266 |
| 5 | GPT-5.4 | Medium | 12 | #135 |
| 6 | DeepSeek V3.2 | 8 | #419 | |
| 7 | Qwen 3.5 397B A17B | 4 | #264 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=smdd-bench-2d-pharmacophore-identification · How It Works · Data refreshed daily, snapshot 2026-11-21.