SommBench - Wine Theory QA (Italian): leaderboard

Metric: Wine theory QA accuracy (%) with Italian prompts: accuracy on SommBench's 128 four-option wine theory questions (WSET-style oenology), answered with a single letter, zero-shot, temperature 0, one run; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 21 models tracked.

Top models

#ModelScoreOverall rank
1GPT-598#91
2Grok 498#169
3Gemini 2.5 Pro96#145
4Grok 4 Fast94#242
5Gemini 2.5 Flash93#237
6GPT-4.191#240
7GPT-4o90#333
8GPT-OSS-120B (High)89#330 (GPT-OSS-120B)
9Gemini 2.5 Flash Lite85#413
10GPT-OSS-120B (Medium)84#330 (GPT-OSS-120B)
11GPT-4o Mini81#588
12GPT-OSS-120B (Low)81#330 (GPT-OSS-120B)
13GPT-4.1 Mini77#346
14GPT-OSS-20B (Medium)76#499 (GPT-OSS-20B)
15GPT-4.1 Nano74#716

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=sommbench-wine-theory-qa-italian · How It Works · Data refreshed daily, snapshot 2026-10-11.