Open Japanese LLM - FA: leaderboard

Metric: Score (%). Source: huggingface.co. 418 models tracked.

Top models

#ModelScore
1Llama-3.3-Swallow-70B-Instruct-v0.432.82
2qwen2.5-bakeneko-32B-instruct-v229.74
3Llama 3.1 70B29.59
4Llama 3 70B29.42
5aya-expanse-32B29.35
6Llama 3 70B Instruct29.22
7Qwentile2.5-32B-Instruct29.17
8QwQ 32B-Preview28.13
9Awqward2.5-32B-Instruct28.11
10DeepSeek-R1-Distill-Qwen-32B-Japanese28.03
11Qwen 2.5 32B27.89
12Qwen2.5-14B-Instruct-1M27.79
13Qwen 2.5 Coder 32B Instruct27.69
14Gemma 2 27B (IT)27.38
15Qwen 2.5 32B Instruct27.37

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-fa · How It Works · Data refreshed daily, snapshot 2026-09-05.