SISS Defense Protocol - Conditional Remaining Attack Success: leaderboard
SISS measures changes in hidden-text recovery between native and aggressively downsampled images. That cross-scale shift is distinct from a web agent taking an attacker-directed action. Main, web-agent and defense experiments use separate protocols; conditional remaining attack success uses the publisher’s paired counts. This board reports native paired conditional remaining ASR (%). Lower is better.
Metric: Native paired conditional remaining ASR (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen2.5-VL-7B-Instruct (Harness: SISS defense ScaleGuard (adaptive)) | 35.3 | |
| 2 | Qwen2.5-VL-7B-Instruct (Harness: SISS defense ScaleGuard (non-adaptive)) | 39.5 | |
| 3 | Qwen 2.5 VL 7B Instruct (Harness: SISS defense Median reconstruction) | 94.1 | |
| 4 | Qwen 2.5 VL 7B Instruct (Harness: SISS defense Gaussian low-pass) | 94.1 | |
| 5 | Qwen2.5-VL-7B-Instruct (Harness: SISS defense Randomized masking (5 reps.)) | 94.1 | |
| 6 | Qwen 2.5 VL 7B Instruct (Harness: SISS defense Area resampling) | 95.6 | |
| 7 | Qwen2.5-VL-7B-Instruct (Harness: SISS defense JPEG(75) + + area) | 95.6 |
Interactive version: theaggregate.ai/benchmark?slug=siss-defense-protocol-conditional-remaining-attack-success · How It Works · Data refreshed daily, snapshot 2026-11-16.