Olfactory Perception Benchmark - Odor Intensity: leaderboard

Olfactory Perception task: decide which of two molecules smells more intense, based on human psychophysical ratings. Accuracy in percent, higher is better.

Metric: Score (%) on odor intensity paired comparison (which of two molecules smells more intense, 175 pairs from Keller et al. 2017 ratings; any-overlap accuracy) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Around September 2028. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.6Max74.9#113
2GPT-5.2 ProHigh72.6#137
3GPT-5 Pro71.4#163
4Claude Opus 4.5High71.4#160
5DeepSeek Reasoner (Thinking 8K) (Olfactory Perception checkpoint unspecified)71.4
6GPT-5Low70.9#178
7DeepSeek Reasoner (Thinking 32K) (Olfactory Perception checkpoint unspecified)69.7
8O4 MiniHigh69.1#368
9DeepSeek Reasoner (Thinking 16K) (Olfactory Perception checkpoint unspecified)68.6
10Llama 3.3 70B Instruct68#1385
11O3High68#237
12Grok 3 MiniHigh68#565
13Gemini 2.5 ProThinking, 16K68#276
14Claude Sonnet 4.566.9#261
15Grok 4.1 Fast66.9#427

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-odor-intensity · How It Works · Data refreshed daily, snapshot 2026-11-21.