Swallow - Pre-trained Japanese - JSQuAD: leaderboard

Metric: Character F1 (%). Source: swallow-llm.github.io. 50 models tracked.

Top models

#ModelScore
1Qwen 2.5 72B93
2sarashina2-70B92.9
3Llama 3.1 70B92.5
4Qwen 2.5 32B92.5
5Qwen 2.5 14B92.3
6Qwen3-14B-Base92.1
7Qwen3-30B-A3B-Base91.8
8Gemma 2 27B91.6
9Llama 4 Scout Base91.5
10gemma-3-27B-pt91.5
11Qwen3-8B-Base91.2
12gemma-3-12B-pt91.1
13plamo-2-8B91
14Qwen3-4B-Base90.8
15Qwen 2.5 7B90.7

Interactive version: theaggregate.ai/benchmark?slug=swallow-pre-trained-japanese-jsquad · How It Works · Data refreshed daily, snapshot 2026-09-19.