Open Japanese LLM - AIO Char F1 Leaderboard — The Aggregate

Open Japanese LLM - AIO Char F1: leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#	Model	Score
1	Llama-3.3-Swallow-70B-Instruct-v0.4	89.25
2	aya-expanse-32B	74.89
3	ABEJA-Qwen2.5-32B-Japanese-v1.0	74.07
4	Llama 3 70B	73.47
5	Llama 3.1 70B	72.96
6	Llama 3.1 Nemotron 70B Instruct	72.7
7	Llama 3.1 70B Instruct	72.64
8	aya-23-35B	70.88
9	Llama 3.3 70B Instruct	70.84
10	Gemma 2 27B (IT)	69.27
11	Llama 3 70B Instruct	67.3
12	Llama 2 70B Base	67.17
13	DeepSeek R1 Distill Llama 70B	65.59
14	QwQ 32B-Preview	58.75
15	Qwentile2.5-32B-Instruct	58.38

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-aio-char-f1 · How It Works · Data refreshed daily, snapshot 2026-09-05.