Open Japanese LLM - Commonsensemoralja Exact Match: leaderboard

The "Commonsensemoralja Exact Match" subtask of Open Japanese LLM. A task from the Open Japanese LLM Leaderboard, evaluating models on Japanese-language knowledge, reasoning and understanding.

Metric: Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 418 models tracked.

Top models

#ModelScoreOverall rank
1llm-jp-3.1-13B-instruct493.84#835
2ABEJA-Qwen2.5-32B-Japanese-v1.092.69#503
3Llama-3.3-Swallow-70B-Instruct-v0.491.68#529
4Llama-3.1-Tulu-3-70B91.41#482
5QwQ 32B-Preview91.26#651
6EZO-Qwen2.5-32B-Instruct91.23#471
7Llama 3.3 70B Instruct91.21#534
8cogito-v1-preview-qwen-14B90.96
9qwen2.5-bakeneko-32B-instruct-v290.78#562
10Llama 3.1 70B90.63#592
11Qwentile2.5-32B-Instruct90.58#339
12Llama 3.1 Nemotron 70B Instruct90.51#554
13Qwen2.5-32B-Instruct-abliterated-v290.51#394
14Lamarckvergence-14B90.48#545
15Qwen 2.5 32B Instruct90.46#498

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-commonsensemoralja-exact-match · How It Works · Data refreshed daily, snapshot 2026-10-20.