Swallow - English MT-Bench - Math: leaderboard

From the Swallow LLM Leaderboard: English MT-Bench, two-turn dialogues graded by GPT-5.2 against reference answers; normalized 0-1 upstream, shown as 0-100, higher is better. This board covers the Math category: algebra, geometry, probability and number-theory problems.

Metric: Judge Score (normalized, %). Source: swallow-llm.github.io. Saturation forecast: Estimated already saturated. 68 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 Next 80B A3B (Thinking)100#312
2Qwen 3 32B (Thinking)99.7#449 (Qwen 3 32B)
3O3 (2025-04-16) (Medium)99.6#125 (O3 (2025-04-16))
4Qwen 3 235B A22B 2507 (Thinking)99.4#263
5qwq-bakeneko-32B99.3#535
6GPT-OSS-Swallow-120B-RL-v0.1 (Thinking)99.3#309 (GPT-OSS-Swallow-120B-RL-v0.1)
7GPT-5 Mini (2025-08-07) (Medium)99.3#175 (GPT-5 Mini (2025-08-07))
8gemma-4-26B-A4B-it (Thinking)99.2
9Qwen 3 Next 80B A3B Instruct99.1#381
10O3 Mini (Medium)99.1#282 (O3 Mini)
11Qwen 3.5 122B A10B (Thinking)98.9#184 (Qwen 3.5 122B A10B)
12Qwen 3 235B A22B 2507 Instruct98.7#315
13NVIDIA-Nemotron-Nano-9B-v2-Japanese (Thinking)98.7#634 (NVIDIA-Nemotron-Nano-9B-v2-Japanese)
14Qwen 3 14B (Reasoning)98.6#542 (Qwen 3 14B)
15Qwen 3.5 27B (Thinking)98.6#192 (Qwen 3.5 27B)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=swallow-english-mt-bench-math · How It Works · Data refreshed daily, snapshot 2026-11-05.