Open Japanese LLM - Wiki Reading Char F1 Leaderboard — The Aggregate

Open Japanese LLM - Wiki Reading Char F1: leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#	Model	Score
1	Llama-3.3-Swallow-70B-Instruct-v0.4	90.2
2	Llama 3.1 70B	87.2
3	aya-expanse-32B	87.05
4	Llama 3 70B	86.82
5	Llama 3.1 70B Instruct	86.16
6	Llama 3.1 Nemotron 70B Instruct	85.82
7	Llama 3.3 70B Instruct	85.01
8	Llama 3 70B Instruct	83.93
9	qwen2.5-bakeneko-32B-instruct-v2	83.46
10	Gemma 2 27B (IT)	83.03
11	Qwen 2.5 32B Instruct	82.04
12	Awqward2.5-32B-Instruct	82
13	Qwen2.5-32B-Instruct-CFT	81.96
14	Qwen 2.5 32B	81.87
15	aya-23-35B	81.69

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-wiki-reading-char-f1 · How It Works · Data refreshed daily, snapshot 2026-09-05.