Olfactory Perception Benchmark - Rate-All-That-Apply: leaderboard

Metric: Score (%) on rate-all-that-apply descriptor profiling (select every applicable descriptor from 138 for 100 molecules; per-question multilabel F1) of the 1,010 questions of the Olfactory Perception (OP) benchmark presented with compound-name prompts (the isomeric SMILES variant is reported only in figures), constrained option lists, provider APIs without web search or tools, each model at its stated reasoning effort or thinking budget; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 21 models tracked.

Top models

#ModelScore
1Claude Opus 4.5 (High)42.2
2Claude Opus 4.6 (High)40
3Claude Opus 4.6 (Max)38.9
4Grok 3 Mini (High)37
5GPT-5 (High)36.4
6GPT-5 Pro36.1
7Grok 3 Mini (Low)36
8Grok 4.1 Fast35.5
9Claude Sonnet 4.534.9
10O3 (High)31.5
11GPT-5 (Low)30.8
12O4 Mini (High)29
13Llama 3.3 70B Instruct26.8
14GPT-OSS-120B (High)25.1

Interactive version: theaggregate.ai/benchmark?slug=olfactory-perception-benchmark-rate-all-that-apply · How It Works · Data refreshed daily, snapshot 2026-10-07.