Olfactory Perception Benchmark - Rate-All-That-Apply: leaderboard
Olfactory Perception task: select every odor descriptor that applies to a molecule from a 138-term lexicon. Per-question multilabel F1 in percent, higher is better.
Metric: Score (%) on rate-all-that-apply descriptor profiling (select every applicable descriptor from 138 for 100 molecules; per-question multilabel F1) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 16 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Opus 4.5 | High | 42.2 | #160 |
| 2 | Claude Opus 4.6 | High | 40 | #113 |
| 3 | Grok 3 Mini | High | 37 | #565 |
| 4 | GPT-5 | High | 36.4 | #178 |
| 5 | GPT-5 Pro | 36.1 | #163 | |
| 6 | DeepSeek Reasoner (Thinking 16K) (Olfactory Perception checkpoint unspecified) | 36 | ||
| 7 | Grok 4.1 Fast | 35.5 | #427 | |
| 8 | Claude Sonnet 4.5 | 34.9 | #261 | |
| 9 | DeepSeek Reasoner (Thinking 8K) (Olfactory Perception checkpoint unspecified) | 34.7 | ||
| 10 | GPT-5.2 Pro | High | 34.6 | #137 |
| 11 | Gemini 2.5 Pro | Thinking, 32K | 34 | #276 |
| 12 | DeepSeek Reasoner (Thinking 32K) (Olfactory Perception checkpoint unspecified) | 33.1 | ||
| 13 | O3 | High | 31.5 | #237 |
| 14 | O4 Mini | High | 29 | #368 |
| 15 | Llama 3.3 70B Instruct | 26.8 | #1385 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-rate-all-that-apply · How It Works · Data refreshed daily, snapshot 2026-11-21.