SEA-HELM (Filipino) - Summarization: leaderboard

Abstractive summarization of Filipino news articles. Normalized 0-100 score from AI Singapore's SEA-HELM leaderboard: (score - random baseline) / (maximum - baseline), floored at 0 and averaged over eight runs; higher is better.

Metric: Normalized Score. Source: leaderboard.sea-lion.ai. Saturation forecast: Around 2037. 58 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 26B A4B (IT) (Reasoning)26.03#293 (Gemma 4 26B A4B (IT))
2Llama 3.1 8B Instruct25.52#1017
3Llama-SEA-LION-v3-70B-IT25.04#407
4Llama 3.3 70B Instruct24.33#541
5Qwen 3.5 122B A10B (Reasoning)22.84#184 (Qwen 3.5 122B A10B)
6GLM-4.7 Flash (Reasoning)22.53#543 (GLM-4.7 Flash)
7Qwen 3.5 27B (Reasoning)22.44#192 (Qwen 3.5 27B)
8MERaLiON-2-10B21.67#600
9Qwen 3.5 9B (Reasoning)21.46#391 (Qwen 3.5 9B)
10Llama 4 Scout Instruct21.36#547
11Qwen 3.5 35B A3B (Reasoning)21.21#268 (Qwen 3.5 35B A3B)
12OLMo 3.1 32B Instruct21.15#755
13Qwen 3.6 27B (Reasoning)21.03#182 (Qwen 3.6 27B)
14Qwen 3.6 35B A3B (Reasoning)21#238 (Qwen 3.6 35B A3B)
15Qwen 3 VL 8B Instruct20.8#419

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=sea-helm-filipino-summarization · How It Works · Data refreshed daily, snapshot 2026-11-05.