Swallow - English MT-Bench - Humanities: leaderboard

From the Swallow LLM Leaderboard: English MT-Bench, two-turn dialogues graded by GPT-5.2 against reference answers; normalized 0-1 upstream, shown as 0-100, higher is better. This board covers the Humanities category: essays and strategies on law, economics, history, philosophy and education.

Metric: Judge Score (normalized, %). Source: swallow-llm.github.io. Saturation forecast: Estimated already saturated. 68 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5 (Medium)85.3#105 (GPT-5)
2GPT-5 Mini (2025-08-07) (Medium)83.4#175 (GPT-5 Mini (2025-08-07))
3O3 (2025-04-16) (Medium)82.9#125 (O3 (2025-04-16))
4Gemma 4 31B (IT) (Thinking)82.4#178 (Gemma 4 31B (IT))
5Qwen 3 235B A22B 2507 Instruct81.8#315
6gemma-4-26B-A4B-it (Thinking)81.5
7GPT-5.4 (2026-03-05) (Medium)81.2#63 (GPT-5.4 (2026-03-05))
8Qwen 3.5 122B A10B (Thinking)79.6#184 (Qwen 3.5 122B A10B)
9GPT-4.178.5#258
10Qwen 3.5 35B A3B (Thinking)78.2#268 (Qwen 3.5 35B A3B)
11Qwen 3.5 27B (Thinking)77.9#192 (Qwen 3.5 27B)
12Qwen 3 Next 80B A3B (Thinking)77.5#312
13Gemma 3 27B (IT)77.4#528
14Gemma 3 12B (IT)77.2#672
15Qwen 3 Next 80B A3B Instruct77.2#381

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=swallow-english-mt-bench-humanities · How It Works · Data refreshed daily, snapshot 2026-11-05.