Nejumi 4 - GLP - Logical Reasoning: leaderboard

The reasoning category of the Japanese MT-Bench: ten open-ended reasoning prompts, each played out over two turns in free text. An LLM judge rates every answer from one to ten and the board rescales that average onto a 0 to 100 range where higher is better. Source: github.com/wandb/llm-leaderboard.

Metric: Score (%). Source: nejumi.ai. Saturation forecast: Around January 2027. 139 models tracked.

Top models

#ModelScoreOverall rank
1Inkling Small98.5#138
2Claude Fable 598#16
3Muse Spark Open97#54
4Inkling96.5#126
5Qwen3.8 2.4T A95B96.5#55
6GLM-5.3 Flash96#65
7Claude Opus 595.5#12
8Muse Glimmer 30B95#178
9Claude Sonnet 4.694.5#90
10MiniMax-M394.5#136
11Qwen 3 235B A22B 2507 (Thinking)94.5#260 (Qwen 3 235B A22B 2507)
12Hy394.5#93
13Ornith-1.5-9B94.5
14Gemini 3.1 Pro (Preview)94#58
15Qwen 3.5 4B94#475

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-glp-logical-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-20.