Open Japanese LLM - Wikicorpus E TO J Bleu JA: leaderboard

The "Wikicorpus E TO J Bleu JA" subtask of Open Japanese LLM. A task from the Open Japanese LLM Leaderboard, evaluating models on Japanese-language knowledge, reasoning and understanding.

Metric: Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 418 models tracked.

Top models

#ModelScoreOverall rank
1llm-jp-3.1-13B-instruct424.01#835
2llm-jp-3.1-1.8B-instruct420.47#1273
3Llama 3.1 Nemotron 70B Instruct16.75#554
4Llama 3.1 70B Instruct16.63#561
5Llama 3 70B16.12#631
6Llama 3.3 70B Instruct15.86#534
7Llama 3.1 70B15.48#592
8Llama-3.1-Tulu-3-70B15.38#482
9Llama 2 70B Base14.17#1025
10Qwen 2.5 32B13.7#546
11Llama-3.3-Swallow-70B-Instruct-v0.413.52#529
12aya-expanse-32B13.02#692
13DeepSeek R1 Distill Llama 70B13.02#594
14Qwentile2.5-32B-Instruct12.95#339
15Gemma 2 27B (IT)12.45#645

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-wikicorpus-e-to-j-bleu-ja · How It Works · Data refreshed daily, snapshot 2026-10-20.