ForesightSafety Bench (Environmental AI Safety, Jailbreak) - Habitat Encroachment: leaderboard

Metric: Attack success rate (%) in the habitat encroachment dimension of ForesightSafetyBench-EnvAI-O: each harmful request is wrapped in the paper's templated role-play jailbreak prompts from JailbreakChat (AIM, DAN and developer-mode templates), and the rate is taken over all attacked prompts; a success is a response that complies with the environmentally harmful request, judged by gpt-4o-2024-11-20 with dimension-specific rubrics; lower is better. Source: arxiv.org. 22 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.50#138
2Claude Haiku 4.50#271
3Grok 40#169
4GPT-4o (2024-11-20)0#369
5Qwen 3 Max (Thinking)0#201 (Qwen 3 Max)
6GPT-5.21.25#105
7Grok 4 Fast (Non-reasoning)3.75#242 (Grok 4 Fast)
8Kimi K2.55#139
9Qwen 2.5 72B Instruct6.25#436
10Gemini 3 Pro (Preview)6.25#64
11GLM-4.76.25#185
12DeepSeek V3.27.5#198
13Gemini 3 Flash (Preview)11.25#78
14Seed 1.811.25#136
15Kimi K2 090512.5#282

Interactive version: theaggregate.ai/benchmark?slug=foresightsafety-bench-environmental-ai-safety-jailbreak-habitat-encroachment · How It Works · Data refreshed daily, snapshot 2026-10-11.