Swallow - Pre-trained English - HellaSwag: leaderboard

Metric: Accuracy (%). Source: swallow-llm.github.io. 50 models tracked.

Top models

#ModelScore
1Llama 3.1 70B69
2Llama 4 Scout Base68.9
3Qwen 2.5 72B68.5
4Gemma 2 27B67.5
5gemma-3-27B-pt66.7
6Qwen 2.5 32B65.6
7Qwen 2.5 14B64.2
8gemma-3-12B-pt63.7
9Qwen3-30B-A3B-Base63.1
10sarashina2-70B62.8
11Gemma 2 9B62.6
12Qwen3-14B-Base62.5
13Llama 3.1 8B60.9
14Qwen 2.5 7B60
15Falcon3-10B-Base59.6

Interactive version: theaggregate.ai/benchmark?slug=swallow-pre-trained-english-hellaswag · How It Works · Data refreshed daily, snapshot 2026-09-19.