SEA-HELM (Malay) - Toxicity Detection: leaderboard

Toxicity detection: classifying whether Malay social-media text is toxic or abusive. Normalized 0-100 score from AI Singapore's SEA-HELM leaderboard: (score - random baseline) / (maximum - baseline), floored at 0 and averaged over eight runs; higher is better.

Metric: Normalized Score. Source: leaderboard.sea-lion.ai. 58 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.3 70B Instruct17.51#541
2Qwen 3 VL 8B Instruct16.84#419
3Apertus-70B-Instruct-250916.57#819
4Llama 3.1 8B Instruct14.82#1017
5MERaLiON-2-10B14.61#600
6Gemma 3 27B (IT)14.41#528
7Llama-SEA-LION-v3-8B-IT14.39#800
8Qwen 3 VL 32B Instruct14.1#290
9Gemma 3 12B (IT)13.81#672
10Llama-SEA-LION-v3-70B-IT13.68#407
11Llama 4 Scout Instruct13.64#547
12Qwen 3 VL 4B Instruct12.9#510
13Gemma 4 26B A4B (IT) (Reasoning)12.08#293 (Gemma 4 26B A4B (IT))
14Mistral Small 412.03#522
15Qwen 3.5 4B (Reasoning)11.82#514 (Qwen 3.5 4B)

Interactive version: theaggregate.ai/benchmark?slug=sea-helm-malay-toxicity-detection · How It Works · Data refreshed daily, snapshot 2026-11-05.