HELM ThaiExam - TPAT-1 — leaderboard

Metric: EM. Source: crfm.stanford.edu. 42 models tracked.

Top models

#ModelScore
1Llama 3.1 405B Instruct68.1
2Claude 3.5 Sonnet (20240620)64.66
3Llama 3.1 70B Instruct59.48
4Claude 3 Opus (20240229)59.48
5Gemini 1.5 Pro (001)59.48
6Qwen 2 72B Instruct55.17
7GPT-4o (2024-05-13)54.31
8Qwen1.5 Chat (72B)54.31
9Gemini 1.5 Flash (001)53.45
10Llama 3 70B Instruct52.59
11Claude 3 Sonnet (20240229)50.86
12GPT-4 Turbo49.14
13GPT-4o Mini (2024-07-18)47.41
14Claude 3 Haiku (20240307)47.41
15Command-R+47.41

Interactive version: theaggregate.ai/benchmark?slug=helm-thaiexam-tpat-1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.