BrowseSafe++ Adapt - Seed Attack Success: leaderboard

BrowseSafe++ v1 uses paired attack/control webpages. Detection receives one page view without the task, outcome, or injection annotations. Markdown inputs are limited to 40k characters. Temperature is 0 when supported; other parameters use provider defaults. Prompted models remain separate from the trained 0.8B BrowseSafeGuard. The study of three text views and the screenshot-vision study are independent. Adaptive attack success uses a fixed native attacker budget and target-model configuration; lower attack success rate (ASR) is better. Task harnesses are not aliased to native base checkpoints. Attack-goal denominators remain distinct from detection F1. The source budget and seed population are preserved in the primary protocol. Metric: Attack success (%).

Metric: Attack success (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.

Top models

#ModelScoreOverall rank
1BrowseSafe++ target GPT-5.50.49
2BrowseSafe++ target Haiku 4.50.59
3BrowseSafe++ target Kimi K20.59
4BrowseSafe++ target Sonnet 52.05
5BrowseSafe++ target Gem. 3.1 Pro2.93
6BrowseSafe++ target DeepSeek V3.12.93
7BrowseSafe++ target Gem. 3.5 FL4

Interactive version: theaggregate.ai/benchmark?slug=browsesafe-plus-plus-adapt-seed-attack-success · How It Works · Data refreshed daily, snapshot 2026-10-28.