Open Japanese LLM - MC: leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1ABEJA-Qwen2.5-32B-Japanese-v1.091.7
2Llama-3.3-Swallow-70B-Instruct-v0.490.77
3Qwentile2.5-32B-Instruct89.92
4EZO-Qwen2.5-32B-Instruct89.82
5Awqward2.5-32B-Instruct89.79
6Qwen 2.5 32B Instruct89.66
7Qwen2.5-32B-Instruct-CFT89.64
8oxyge1-33B89.63
9Qwen2.5-32B-Instruct-abliterated-v289.57
10QwQ 32B-Preview89.55
11qwen2.5-bakeneko-32B-instruct-v289.54
12Qwen 2.5 32B89.27
13Llama 3.3 70B Instruct88.74
14QwQ-32B88.63
15Llama 3.1 70B Instruct88.54

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-mc · How It Works · Data refreshed daily, snapshot 2026-09-05.