HELM AFR - Overall (Southern Sotho): leaderboard

Metric: Mean score. Source: crfm.stanford.edu. 22 models tracked.

Top models

#ModelScore
1Gemini 2.0 Flash66
2Claude 3.7 Sonnet (20250219)63.62
3GPT-4o (2024-08-06)63.1
4Gemini 2.0 Flash Lite60.04
5DeepSeek V358.44
6GPT-4 Turbo54.11
7Llama 3.1 405B Instruct50.58
8Llama 3.3 70B Instruct50.1
9Llama 3.1 70B Instruct48.31
10Claude 3.5 Haiku (20241022)45.26
11Gemma 2 27B (IT)43.71
12Qwen 2.5 72B Instruct41.22
13Gemma 2 9B (IT)39.18
14Llama 3.1 8B Instruct38.33
15GPT-3.5 Turbo (0125)36.11

Interactive version: theaggregate.ai/benchmark?slug=helm-afr-overall-southern-sotho · How It Works · Data refreshed daily, snapshot 2026-09-08.