HELM EWoK - Physical Interactions — leaderboard

Metric: EM. Source: crfm.stanford.edu. 15 models tracked.

Top models

#ModelScore
1GPT-4 Turbo86.61
2Qwen 2 72B Instruct84.64
3Llama 3 70B Instruct84.29
4Claude 3.5 Sonnet (20240620)83.93
5GPT-4o (2024-05-13)82.14
6Claude 3 Opus (20240229)79.29
7GPT-4o Mini (2024-07-18)76.79
8Claude 3 Sonnet (20240229)73.93
9GPT-3.5 Turbo (0125)71.61
10Claude 3.5 Haiku (20241022)69.46
11Claude 3 Haiku (20240307)69.46
12Mistral 7B Instruct (v0.3)66.61
13Llama 3 8B Instruct8.93

Interactive version: theaggregate.ai/benchmark?slug=helm-ewok-physical-interactions · How the rankings work · Data refreshed daily, snapshot 2026-07-22.