Olfactory Perception Benchmark - Olfactory Receptor Activation: leaderboard

Olfactory Perception task: identify which human olfactory receptors a molecule activates among 4 to 10 candidates, from experimental receptor data. Per-question multilabel F1 in percent, higher is better.

Metric: Score (%) on olfactory receptor activation (which of 4 to 10 human receptors a molecule activates, 80 questions from M2OR; per-question multilabel F1) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 16 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.2 ProHigh52.8#139
2Claude Opus 4.6Max51.1#114
3Claude Opus 4.5High45.8#165
4GPT-5 Pro42.5#168
5O3High42.4#242
6Gemini 2.5 ProThinking, 32K42.4#280
7Grok 3 MiniHigh41.9#559
8GPT-5High40.8#185
9O4 MiniHigh40.5#372
10Claude Sonnet 4.538.4#267
11GPT-OSS-120BHigh35.6#712
12Llama 3.3 70B Instruct35#1394
13DeepSeek Reasoner (Thinking 32K) (Olfactory Perception checkpoint unspecified)31.6
14Grok 4.1 Fast31.1#431
15DeepSeek Reasoner (Thinking 8K) (Olfactory Perception checkpoint unspecified)30.5

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-olfactory-receptor-activation · How It Works · Data refreshed daily, snapshot 2026-11-22.