Open Japanese LLM - Jsem Exact Match — leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1Qwentile2.5-32B-Instruct80.93
2QwQ 32B-Preview80.49
3Llama 3.1 70B Instruct79.92
4Qwen2.5-32B-Instruct-CFT79.86
5QwQ-32B79.8
6Qwen 2.5 32B Instruct79.8
7Awqward2.5-32B-Instruct79.8
8Qwen2.5-32B-Instruct-abliterated-v279.73
9oxyge1-33B79.73
10Llama 3.1 70B79.61
11Llama 3.3 70B Instruct79.42
12DeepSeek R1 Distill Qwen 32B79.42
13Qwen 2.5 32B79.42
14Llama 3 70B79.42
15Llama 3.1 Nemotron 70B Instruct78.91

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-jsem-exact-match · How the rankings work · Data refreshed daily, snapshot 2026-07-22.