Olfactory Perception Benchmark: leaderboard
Metric: Overall score (%): unweighted mean of the eight task scores (accuracy for single-answer tasks, multilabel F1 for rate-all-that-apply and receptor activation; the odor similarity of mixtures task, where no model exceeds chance on similar pairs, is included in the mean) over the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 21 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.6 (Max) | 64.4 |
| 2 | Claude Opus 4.6 (High) | 63.1 |
| 3 | Claude Opus 4.5 (High) | 62 |
| 4 | GPT-5 Pro | 61.9 |
| 5 | GPT-5 (High) | 61.1 |
| 6 | Claude Sonnet 4.5 | 59.6 |
| 7 | GPT-5 (Low) | 59.6 |
| 8 | O3 (High) | 59.3 |
| 9 | O4 Mini (High) | 59 |
| 10 | Grok 4.1 Fast | 58.3 |
| 11 | Grok 3 Mini (High) | 57.9 |
| 12 | Grok 3 Mini (Low) | 57.3 |
| 13 | GPT-OSS-120B (High) | 54 |
| 14 | Llama 3.3 70B Instruct | 52.7 |
Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark · How It Works · Data refreshed daily, snapshot 2026-10-07.