Open Japanese LLM - QA: leaderboard
Metric: Score (%). Source: huggingface.co. 418 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Llama-3.3-Swallow-70B-Instruct-v0.4 | 72.74 |
| 2 | ABEJA-Qwen2.5-32B-Japanese-v1.0 | 66.79 |
| 3 | aya-expanse-32B | 64.95 |
| 4 | Llama 3.1 70B | 64.87 |
| 5 | Llama 3 70B | 64.65 |
| 6 | Llama 3.1 70B Instruct | 64.56 |
| 7 | Llama 3.1 Nemotron 70B Instruct | 64.53 |
| 8 | Llama 3.3 70B Instruct | 64.12 |
| 9 | Llama 3 70B Instruct | 61.25 |
| 10 | aya-23-35B | 59.91 |
| 11 | Gemma 2 27B (IT) | 59.32 |
| 12 | Qwentile2.5-32B-Instruct | 58.26 |
| 13 | QwQ 32B-Preview | 57.75 |
| 14 | Llama 2 70B Base | 57.66 |
| 15 | DeepSeek R1 Distill Llama 70B | 56.66 |
Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-qa · How It Works · Data refreshed daily, snapshot 2026-09-05.