Open Japanese LLM - Jemhopqa Char F1 — leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1Llama 3.3 70B Instruct65.28
2Qwentile2.5-32B-Instruct63.68
3Llama 3.1 70B Instruct63.31
4Llama 3.1 Nemotron 70B Instruct62.05
5QwQ 32B-Preview61.71
6Llama 3.1 70B61.45
7Llama 3 70B Instruct61.02
8Llama 3 70B60.56
9Saka-14B59.69
10Qwen 2.5 14B Instruct58.83
11aya-expanse-32B58.15
12EZO-Qwen2.5-32B-Instruct58.03
13Awqward2.5-32B-Instruct57.86
14Qwen 2.5 32B57.27
15Qwen2.5-32B-Instruct-CFT56.93

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-jemhopqa-char-f1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.