DTap-Bench (Direct Attacks) - macOS: leaderboard
Metric: Attack success rate (%; 50 direct red-teaming macOS desktop tasks: the user is the attacker, with prompt, tool, skill and environment injections; an attack succeeds when a rule-based check of the final environment state finds the malicious goal fully achieved; fixed attack sequences that DTap-Red optimized on a surrogate agent; mean of its risk-category rates). Source: arxiv.org. Saturation forecast: Around August 2028. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-OSS-120B | 20 |
| 2 | GPT-5.4 | 30.4 |
| 3 | Gemini 3 Pro | 30.4 |
| 4 | GPT-5.2 | 40.4 |
Interactive version: theaggregate.ai/benchmark?slug=dtap-bench-direct-attacks-macos · How It Works · Data refreshed daily, snapshot 2026-09-26.