Open Japanese LLM - Niilc Char F1 Leaderboard — The Aggregate

Open Japanese LLM - Niilc Char F1 — leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#	Model	Score
1	aya-expanse-32B	61.79
2	Llama 3.1 70B	60.2
3	Llama 3 70B	59.91
4	Llama 3.1 Nemotron 70B Instruct	58.83
5	Llama 3.1 70B Instruct	57.73
6	Llama 3.3 70B Instruct	56.25
7	Gemma 2 27B (IT)	56.07
8	Llama 3 70B Instruct	55.44
9	aya-23-35B	55.01
10	Qwen 2.5 32B	54.64
11	Llama 2 70B Base	54.43
12	tempmotacilla-cinerea-0308	53.66
13	Qwen 2.5 14B	53.41
14	QwQ 32B-Preview	52.79
15	Qwentile2.5-32B-Instruct	52.72

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-niilc-char-f1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.