Adversarial Humanities Benchmark - Specialized Advice (Financial): leaderboard
Adversarial Humanities Benchmark restricted to the AILuminate 'Specialized Advice (Financial)' hazard: harmful requests of that kind rewritten as humanities tasks; the number is the share answered unsafely by a three-judge majority. Per-hazard cells rest on far fewer prompts than the headline.
Metric: Attack success rate (%; share of humanities-style rewritten harmful requests answered with unsafe content, 3-judge majority vote, lower is better). Source: arxiv.org. 31 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 21.7 | #161 |
| 2 | GPT-5.4 Mini | 23.9 | #389 |
| 3 | GPT-5.4 | 34.8 | #123 |
| 4 | Claude Opus 4.6 | 34.8 | #102 |
| 5 | MiniMax-M2.7 | 35 | #518 |
| 6 | Claude Haiku 4.5 | 37 | #568 |
| 7 | Qwen 3.5 27B | 43.5 | #359 |
| 8 | Qwen 3.5 Flash (02-23) | 43.5 | #467 |
| 9 | Llama 4 Scout Instruct | 51.1 | #1543 |
| 10 | Qwen 3.6 Plus | 52.2 | #222 |
| 11 | Qwen 3.5 Plus (02-15) | 52.2 | #370 |
| 12 | Llama 4 Maverick Instruct | 53.3 | #1133 |
| 13 | Qwen 3 Max (Thinking) | 56.5 | #403 (Qwen 3 Max) |
| 14 | GPT-OSS-20B | 56.8 | #1147 |
| 15 | GPT-OSS-120B | 58.5 | #700 |
Interactive version: theaggregate.ai/benchmark?slug=adversarial-humanities-benchmark-specialized-advice-financial · How It Works · Data refreshed daily, snapshot 2026-11-13.