Open Japanese LLM - MMLU EN Exact Match — leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1Llama 3.3 70B Instruct81.62
2Llama 3.1 Nemotron 70B Instruct81.23
3Llama 3.1 70B Instruct80.99
4Qwentile2.5-32B-Instruct80.89
5Awqward2.5-32B-Instruct80.12
6oxyge1-33B80.07
7Qwen2.5-32B-Instruct-CFT80.01
8Qwen 2.5 32B Instruct80
9Qwen2.5-32B-Instruct-abliterated-v279.62
10QwQ 32B-Preview79.55
11EZO-Qwen2.5-32B-Instruct79.23
12Qwen 2.5 32B79.2
13Llama 3 70B Instruct77.92
14DeepSeek R1 Distill Qwen 32B77.89
15DeepSeek R1 Distill Llama 70B77

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-mmlu-en-exact-match · How the rankings work · Data refreshed daily, snapshot 2026-07-22.