Olfactory Perception Benchmark - Odor Classification: leaderboard

Olfactory Perception task: decide whether a molecule, given by compound name, is odorous or odorless, on a balanced set of 175 molecules. Accuracy in percent, higher is better.

Metric: Score (%) on odor classification (odorous or odorless, 175 molecules, balanced; any-overlap accuracy) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.6Max92#113
2GPT-5 Pro92#163
3Claude Opus 4.5High92#160
4GPT-5Low90.3#178
5Gemini 2.5 ProThinking, 16K89.7#276
6Claude Sonnet 4.589.1#261
7O3High89.1#237
8Grok 4.1 Fast88.6#427
9O4 MiniHigh88.6#368
10GPT-5.2 ProHigh88.6#137
11Llama 3.3 70B Instruct83.4#1385
12GPT-OSS-120BHigh82.9#704
13Grok 3 MiniHigh81.7#565
14DeepSeek Reasoner (Thinking 32K) (Olfactory Perception checkpoint unspecified)81.1
15DeepSeek Reasoner (Thinking 8K) (Olfactory Perception checkpoint unspecified)80.6

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-odor-classification · How It Works · Data refreshed daily, snapshot 2026-11-21.