FinSafetyBench - Ethical Violations (Chinese): leaderboard

Metric: Attack success rate (%; mean over the PAIR, ReNeLLM and FlipAttack jailbreaks; share of the benchmark's ethical-violation instructions in Chinese whose jailbroken response a Qwen3-32B judge rates a complete violation (10 of 10)). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScore
1Llama 3 8B Instruct42.57
2InternLM3-8B-Instruct46.92
3GLM-4 9B (0414)61.59
4Qwen 2.5 32B Instruct65.53
5Mistral Small 370.87

Interactive version: theaggregate.ai/benchmark?slug=finsafetybench-ethical-violations-chinese · How It Works · Data refreshed daily, snapshot 2026-09-26.