HELM ThaiExam - ONET — leaderboard

Metric: EM. Source: crfm.stanford.edu. 42 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20240620)73.46
2Claude 3 Opus (20240229)66.67
3GPT-4o (2024-05-13)63.58
4Llama 3.1 405B Instruct61.73
5Gemini 1.5 Pro (001)61.11
6Qwen 2 72B Instruct60.49
7Llama 3.1 70B Instruct59.88
8Gemini 1.5 Flash (001)58.02
9GPT-4o Mini (2024-07-18)56.79
10GPT-4 Turbo53.7
11Llama 3 70B Instruct50.62
12Claude 3 Haiku (20240307)50.62
13Claude 3 Sonnet (20240229)48.77
14Qwen1.5 Chat (72B)45.06
15Gemini 1.0 Pro (002)43.83

Interactive version: theaggregate.ai/benchmark?slug=helm-thaiexam-onet · How the rankings work · Data refreshed daily, snapshot 2026-07-22.