Swallow - Pre-trained Japanese - NIILC: leaderboard

Metric: Character F1 (%). Source: swallow-llm.github.io. 50 models tracked.

Top models

#ModelScore
1sarashina2-70B66.8
2sarashina2-13B66.1
3plamo-2-8B65.5
4llm-jp-3-13B64.9
5sarashina2.2-3B64.2
6sarashina2-7B63.4
7gemma-3-27B-pt62.7
8Qwen 2.5 72B61.9
9Llama 4 Scout Base61.6
10Llama 3.1 70B60.3
11llm-jp-3-7.2B60.1
12Gemma 2 27B57.3
13gemma-3-12B-pt56.9
14llm-jp-3-3.7B54.1
15Qwen 2.5 32B53.8

Interactive version: theaggregate.ai/benchmark?slug=swallow-pre-trained-japanese-niilc · How It Works · Data refreshed daily, snapshot 2026-09-19.