KorSET (Direct Request) - Information and Safety Harms: leaderboard
Metric: Attack success rate (%) of KorSET's Information & Safety Harms prompts sent as direct requests (no adversarial optimization) to the target model; a GPT-4.1 judge with the authors' safety rubric decides whether each response is harmful; lower is better. Source: arxiv.org. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemma 2 9B (IT) | 4.96 | #774 |
| 2 | EXAONE 3.5 7.8B Instruct | 6.65 | #850 |
| 3 | Qwen 2.5 7B Instruct | 15.71 | #846 |
| 4 | Gemma 3 12B (IT) | 25.75 | #655 |
| 5 | Llama 3.1 8B Instruct | 53.62 | #1018 |
Interactive version: theaggregate.ai/benchmark?slug=korset-direct-request-information-and-safety-harms · How It Works · Data refreshed daily, snapshot 2026-10-11.