SEA-HELM (Indonesian) - Summarization: leaderboard

Metric: Normalized Score. Source: leaderboard.sea-lion.ai. 44 models tracked.

Top models

#ModelScore
1Llama 3.3 70B Instruct18.79
2Gemma 4 26B A4B (IT)18.64
3Gemma 4 31B (IT)18.45
4Llama 4 Scout Instruct18.15
5Llama 3.1 8B Instruct17.95
6Gemma 4 12B (IT)17.14
7Qwen 3.6 35B A3B17.06
8Apertus-8B-Instruct-250916.97
9Llama 3.2 3B Instruct16.9
10Mistral Medium 3.516.82
11gemma-4-E4B-it16.41
12Qwen 3.5 27B16.39
13Qwen 3.5 35B A3B16.31
14Gemma 3 27B (IT)16.29
15GLM-4.7 Flash15.97

Interactive version: theaggregate.ai/benchmark?slug=sea-helm-indonesian-summarization · How It Works · Data refreshed daily, snapshot 2026-09-19.