MMLU-by-task - Marketing: leaderboard

The "Marketing" subtask of MMLU-by-task. A single MMLU subject, reporting per-task multiple-choice accuracy from the MMLU-by-task leaderboard across a wide range of academic and professional domains.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 1257 models tracked.

Top models

#ModelScoreOverall rank
1Llama 2 70B Chat91.45#1237
2Llama 2 70B Base90.6#1025
3StableBeluga289.32#1078
4Xwin-LM-70B-V0.189.32#982
5vicuna-33B-v1.387.61#1347
6Mistral-7B-v0.187.18#1326
7Llama 2 70B Chat (HF)87.18#1264
8WizardLM-70B-V1.087.18#1236
9internlm-20B85.9#1296
10vicuna-13B-v1.583.33#1392
11vicuna-13B-v1.382.48#1447
12OpenHermes-13B82.48#1393
13falcon-40B Instruct82.05#1458
14WizardLM-13B-V1.281.62#1425
15Chinese-Alpaca-2-13B80.77#1414

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mmlu-by-task-marketing · How It Works · Data refreshed daily, snapshot 2026-10-20.