Olfactory Perception Benchmark - Odor Pleasantness: leaderboard

Olfactory Perception task: decide which of two molecules smells more pleasant, based on human psychophysical ratings. Accuracy in percent, higher is better.

Metric: Score (%) on odor pleasantness paired comparison (which of two molecules smells more pleasant, 175 pairs; any-overlap accuracy) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.6High74.9#114
2DeepSeek Reasoner (Thinking 16K) (Olfactory Perception checkpoint unspecified)74.9
3O4 MiniHigh73.7#372
4Grok 3 MiniHigh73.7#559
5Gemini 2.5 ProThinking, 8K73.7#280
6Claude Opus 4.5High73.1#165
7DeepSeek Reasoner (Thinking 32K) (Olfactory Perception checkpoint unspecified)73.1
8DeepSeek Reasoner (Thinking 8K) (Olfactory Perception checkpoint unspecified)72.6
9Llama 3.3 70B Instruct72#1394
10GPT-OSS-120BHigh72#712
11GPT-5.2 ProHigh72#139
12Claude Sonnet 4.571.4#267
13GPT-5High71.4#185
14GPT-5 Pro70.9#168
15Grok 4.1 Fast70.3#431

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-odor-pleasantness · How It Works · Data refreshed daily, snapshot 2026-11-22.