HELM EWoK - Social Properties: leaderboard

Metric: Exact Match (%). Source: crfm.stanford.edu. 15 models tracked.

Top models

#ModelScore
1GPT-4 Turbo98.65
2GPT-4o (2024-05-13)95.95
3GPT-3.5 Turbo (0125)94.59
4Claude 3.5 Sonnet (20240620)94.32
5GPT-4o Mini (2024-07-18)94.32
6Claude 3 Opus (20240229)92.97
7Claude 3 Haiku (20240307)92.97
8Qwen 2 72B Instruct92.43
9Claude 3.5 Haiku (20241022)90.27
10Llama 3 70B Instruct90
11Claude 3 Sonnet (20240229)87.84
12Mistral 7B Instruct (v0.3)85.41
13Llama 3 8B Instruct39.46

Interactive version: theaggregate.ai/benchmark?slug=helm-ewok-social-properties · How It Works · Data refreshed daily, snapshot 2026-09-19.