HELM SeaHELM - Flores (en-id) — leaderboard

Metric: ChrF++. Source: crfm.stanford.edu. 21 models tracked.

Top models

#ModelScore
1GPT-4o (2024-11-20)70.52
2GPT-4o Mini (2024-07-18)69.86
3Claude 3.7 Sonnet (20250219)69.52
4Llama 3.1 405B Instruct68.59
5Gemini 2.0 Flash68.22
6Llama 4 Scout Instruct66.83
7Qwen 2 72B Instruct66.81
8Qwen 2.5 72B Instruct65.91
9Llama 3.1 70B Instruct65.83
10Llama 3.3 70B Instruct60.7
11Llama 3.2 90B Vision Instruct56.17
12Claude 3.5 Haiku (20241022)55.41
13DeepSeek V352.15
14Llama 4 Maverick Instruct FP848.93
15Gemma 2 27B (IT)48.84

Interactive version: theaggregate.ai/benchmark?slug=helm-seahelm-flores-en-id · How the rankings work · Data refreshed daily, snapshot 2026-07-22.