Open Japanese LLM - Wikicorpus E TO J Comet Wmt22: leaderboard

The "Wikicorpus E TO J Comet Wmt22" subtask of Open Japanese LLM. A task from the Open Japanese LLM Leaderboard, evaluating models on Japanese-language knowledge, reasoning and understanding.

Metric: Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 418 models tracked.

Top models

#ModelScoreOverall rank
1llm-jp-3.1-13B-instruct486.4#835
2Llama-3.3-Swallow-70B-Instruct-v0.485.96#529
3Llama-3.1-Tulu-3-70B85.86#482
4Llama 3 70B85.54#631
5Llama 3.1 70B85.42#592
6Llama 3.3 70B Instruct85.17#534
7aya-expanse-32B85.11#692
8Gemma 2 27B (IT)85.04#645
9llm-jp-3.1-1.8B-instruct484.99#1273
10Llama 3 70B Instruct84.71#634
11qwen2.5-bakeneko-32B-instruct-v284.71#562
12EZO-Qwen2.5-32B-Instruct84.44#471
13Qwentile2.5-32B-Instruct84.39#339
14Llama 3.1 Nemotron 70B Instruct84.36#554
15Qwen 2.5 32B84.26#546

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-wikicorpus-e-to-j-comet-wmt22 · How It Works · Data refreshed daily, snapshot 2026-10-20.