HELM AFR - Overall (Tswana): leaderboard

Metric: Mean score. Source: crfm.stanford.edu. 22 models tracked.

Top models

#ModelScore
1Gemini 2.0 Flash68.94
2Claude 3.7 Sonnet (20250219)65.18
3Gemini 2.0 Flash Lite62.65
4GPT-4o (2024-08-06)61.15
5DeepSeek V357.52
6GPT-4 Turbo49.76
7Llama 3.1 405B Instruct49.34
8Llama 3.1 70B Instruct48.48
9Llama 3.3 70B Instruct47.97
10Claude 3.5 Haiku (20241022)46.97
11Gemma 2 27B (IT)43.4
12Qwen 2.5 72B Instruct41.19
13Gemma 2 9B (IT)39.02
14GPT-3.5 Turbo (0125)38.8
15Llama 3.1 8B Instruct36.71

Interactive version: theaggregate.ai/benchmark?slug=helm-afr-overall-tswana · How It Works · Data refreshed daily, snapshot 2026-09-08.