FlavourBench - Substitution: leaderboard

FlavourBench substitution family: 178 of the 534 complete-common-core culinary tasks, scored by executable reward maps (arXiv 2608.20574v3). Family score 0-100, higher is better, from family_scores in data-complete-core/leaderboard.jsonl in the josefchen/flavourbench dataset; each route's recorded reasoning effort is kept in the model label.

Metric: Substitution Family Score (0-100). Source: huggingface.co. Saturation forecast: Around 2030. 27 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.6 Flash (Minimal)68.12#57 (Gemini 3.6 Flash)
2Kimi K3 (Low)65.49#35 (Kimi K3)
3MiniMax-M365.35#151
4Nemotron 3.5 Lightning65.31#461
5Command A64.66#498
6GLM-5.363.69#44
7GLM-5.2 (Non-reasoning)63.63#80 (GLM-5.2)
8Mistral Large 360.35#410
9Llama 4 Maverick59.37#486
10Command-R+ (08-2024)56.66#838

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=flavourbench-substitution · How It Works · Data refreshed daily, snapshot 2026-11-05.