KorSET (Direct Request) - Malicious Use: leaderboard
Metric: Attack success rate (%) of KorSET's Malicious Use prompts sent as direct requests (no adversarial optimization) to the target model; a GPT-4.1 judge with the authors' safety rubric decides whether each response is harmful; lower is better. Source: arxiv.org. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemma 3 12B (IT) | 26.92 | #655 |
| 2 | Gemma 2 9B (IT) | 28.16 | #774 |
| 3 | Qwen 2.5 7B Instruct | 34.77 | #846 |
| 4 | EXAONE 3.5 7.8B Instruct | 41 | #850 |
| 5 | Llama 3.1 8B Instruct | 41.55 | #1018 |
Interactive version: theaggregate.ai/benchmark?slug=korset-direct-request-malicious-use · How It Works · Data refreshed daily, snapshot 2026-10-11.