Nejumi 4 - GLP - Specialized Knowledge: leaderboard

Averages three expert knowledge sets: JMMLU and the Japanese MMLU-ProX multiple-choice exams run through the jaster harness at 0-shot and 2-shot, and a 194-question Japanese version of Humanity's Last Exam with multimodal items removed and inputs kept under 7000 tokens. All closed-book, reported in percent, higher is better. Source: github.com/wandb/llm-leaderboard.

Metric: Score (%). Source: nejumi.ai. Saturation forecast: Around January 2027. 139 models tracked.

Top models

#ModelScoreOverall rank
1Claude Fable 581.39#16
2GPT-5.6 Sol79.19#19
3Claude Opus 578.84#12
4GPT-5.5 (2026-04-23)77.46#22
5Gemini 3.1 Pro (Preview)77.27#58
6GPT-5.6 Terra76.97#41
7Kimi K376.94#30
8GPT-5.4 (2026-03-05)76.63#59
9Hy4 preview76.28#38
10Claude Opus 4.875.99#37
11Grok 4.575.93#48
12Qwen3.8 2.4T A95B75.27#55
13DeepSeek V4.1 Flash75.1#36
14Claude Opus 4.774.94#49
15Muse Spark Open74.58#54

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-glp-specialized-knowledge · How It Works · Data refreshed daily, snapshot 2026-10-20.