BrowseSafe++ HTML - F1: leaderboard

BrowseSafe++ v1 uses paired attack/control webpages. Detection receives one page view without the task, outcome, or injection annotations. Markdown inputs are limited to 40k characters. Temperature is 0 when supported; other parameters use provider defaults. Prompted models remain separate from the trained 0.8B BrowseSafeGuard. The study of three text views and the screenshot-vision study are independent. Adaptive attack success uses a fixed native attacker budget and target-model configuration; lower attack success rate (ASR) is better. Task harnesses are not aliased to native base checkpoints. Fable’s answered-only subset is excluded from the full population; the all-request policy row is retained. Metric: F1 (%).

Metric: F1 (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 17 models tracked.

Top models

#ModelScoreOverall rank
1BrowseSafe++ detector BrowseSafe-Guard98.29
2BrowseSafe++ detector GPT-6 Astra91.55
3BrowseSafe++ detector GPT-5.589.32
4BrowseSafe++ detector Jev 1.1389.17
5BrowseSafe++ detector Qwen 3.7 Max88.96
6BrowseSafe++ detector Gemini 3.1 Pro88.85
7BrowseSafe++ detector Claude Sonnet 588.22
8BrowseSafe++ detector Claude Fable 5.1 (all) †86.56
9BrowseSafe++ detector Claude Opus 5.586.5
10BrowseSafe++ detector Gemini 3.1 Flash-Lite79.97

Interactive version: theaggregate.ai/benchmark?slug=browsesafe-plus-plus-html-f1 · How It Works · Data refreshed daily, snapshot 2026-10-28.