ThaiSafetyBench - General Prompt Attacks: leaderboard

ThaiSafetyBench (SCB DataX and SCB 10X, 2026) sends 1,954 harmful prompts written in Thai to each model and judges the responses with GPT-4.1 and Gemini 2.5 Pro; the attack success rate is averaged over both judges. This board covers its attack group of general harmful prompts not specific to Thai culture. Metric is attack success rate (%), lower is better (safer).

Metric: Attack Success Rate (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 24 models tracked.

Top models

#ModelScoreOverall rank
1GPT-51.76#105
2Claude Sonnet 4.53.3#148
3Qwen 2.5 72B Instruct3.83#469
4Llama-SEA-LION-v3-70B-IT5.54#407
5SeaLLMs-v3-7B-Chat5.7#897
6Qwen 2.5 7B Instruct5.75#863
7GPT-4o5.96#357
8Llama 3.3 70B Instruct6.39#541
9Llama-SEA-LION-v3-8B-IT6.5#800
10Gemma 3 12B (IT)9.27#672
11Llama 3.1 70B Instruct12.52#567
12Llama 3.1 8B Instruct15.34#1017
13Gemma 3 4B (IT)17.65#997
14Llama 3.2 3B Instruct17.89#1327
15Llama 3.2 1B Instruct29.55#1518

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=thaisafetybench-general-prompt-attacks · How It Works · Data refreshed daily, snapshot 2026-11-05.