Open Japanese LLM - Jsem Exact Match: leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1Qwentile2.5-32B-Instruct80.93
2QwQ 32B-Preview80.49
3DeepSeek-R1-Distill-Qwen-32B-Japanese80.24
4Llama 3.1 70B Instruct79.92
5Qwen2.5-32B-Instruct-CFT79.86
6QwQ-32B79.8
7Qwen 2.5 32B Instruct79.8
8Awqward2.5-32B-Instruct79.8
9Qwen2.5-32B-Instruct-abliterated-v279.73
10oxyge1-33B79.73
11Llama 3.1 70B79.61
12Llama 3.3 70B Instruct79.42
13DeepSeek R1 Distill Qwen 32B79.42
14Qwen 2.5 32B79.42
15Llama 3 70B79.42

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-jsem-exact-match · How It Works · Data refreshed daily, snapshot 2026-09-05.