Open Japanese LLM - AIO Char F1 Leaderboard — The Aggregate

Open Japanese LLM - AIO Char F1 — leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#	Model	Score
1	aya-expanse-32B	74.89
2	Llama 3 70B	73.47
3	Llama 3.1 70B	72.96
4	Llama 3.1 Nemotron 70B Instruct	72.7
5	Llama 3.1 70B Instruct	72.64
6	aya-23-35B	70.88
7	Llama 3.3 70B Instruct	70.84
8	Gemma 2 27B (IT)	69.27
9	Llama 3 70B Instruct	67.3
10	Llama 2 70B Base	67.17
11	DeepSeek R1 Distill Llama 70B	65.59
12	QwQ 32B-Preview	58.75
13	Qwentile2.5-32B-Instruct	58.38
14	Qwen 2.5 32B	57.88
15	EZO-Qwen2.5-32B-Instruct	56.22

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-aio-char-f1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.