HELM AFR - MMLU Clinical Knowledge (Afrikaans): leaderboard

Metric: EM. Source: crfm.stanford.edu. 22 models tracked.

Top models

#ModelScore
1Gemini 2.0 Flash88.68
2GPT-4o (2024-08-06)88.3
3DeepSeek V386.79
4Claude 3.7 Sonnet (20250219)86.79
5Qwen 2.5 72B Instruct83.4
6Gemini 2.0 Flash Lite80.75
7Llama 3.1 70B Instruct78.11
8GPT-4 Turbo70.57
9Gemma 2 27B (IT)70.19
10Llama 3.1 405B Instruct69.06
11Claude 3.5 Haiku (20241022)68.68
12GPT-3.5 Turbo (0125)66.04
13GPT-4o Mini (2024-07-18)59.62
14Gemma 2 9B (IT)54.34
15Llama 3.3 70B Instruct49.81

Interactive version: theaggregate.ai/benchmark?slug=helm-afr-mmlu-clinical-knowledge-afrikaans · How It Works · Data refreshed daily, snapshot 2026-09-08.