FinSafetyBench - Financial Crimes (Chinese): leaderboard

Metric: Attack success rate (%; mean over the PAIR, ReNeLLM and FlipAttack jailbreaks; share of the benchmark's financial-crime instructions in Chinese whose jailbroken response a Qwen3-32B judge rates a complete violation (10 of 10)). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScore
1Llama 3 8B Instruct52.65
2InternLM3-8B-Instruct64.96
3Qwen 2.5 32B Instruct80.73
4GLM-4 9B (0414)87.02
5Mistral Small 391.46

Interactive version: theaggregate.ai/benchmark?slug=finsafetybench-financial-crimes-chinese · How It Works · Data refreshed daily, snapshot 2026-09-26.