ForesightSafety Bench (Industrial Safety, Jailbreak) - Healthcare and Medicine: leaderboard

Metric: Attack success rate (%) in the healthcare and medicine sector of ForesightSafetyBench-IndustrialSafety-O: each harmful request is wrapped in the paper's templated role-play jailbreak prompts from JailbreakChat (AIM, DAN and developer-mode templates), and the rate is taken over all attacked prompts; a success is a response that complies with the sector-specific harmful request, judged by gpt-4o-2024-11-20 with dimension-specific rubrics; lower is better. Source: arxiv.org. 18 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.50#138
2Claude Haiku 4.50#271
3Kimi K2.54#139
4GLM-4.74#185
5Claude 3.5 Haiku4.67#553
6Qwen 2.5 72B Instruct5.33#436
7Gemini 3 Pro (Preview)5.33#64
8Gemini 3 Flash (Preview)6#78
9Qwen 3 235B A22B 2507 Instruct11.33#291
10Seed 1.814#136
11Seed-1.614.67#257
12DeepSeek V3.216#198
13Qwen 3 Max (Thinking)16#201 (Qwen 3 Max)
14Kimi K2 090516.67#282
15Llama 4 Maverick26#451

Interactive version: theaggregate.ai/benchmark?slug=foresightsafety-bench-industrial-safety-jailbreak-healthcare-and-medicine · How It Works · Data refreshed daily, snapshot 2026-10-11.