DTap-Bench (Direct Attacks) - Research: leaderboard

Metric: Attack success rate (%; 119 direct red-teaming research tasks: the user is the attacker, with prompt, tool, skill and environment injections; an attack succeeds when a rule-based check of the final environment state finds the malicious goal fully achieved; fixed attack sequences that DTap-Red optimized on a surrogate agent; mean of its risk-category rates). Source: arxiv.org. Saturation forecast: Around 2028. 8 models tracked.

Top models

#ModelScore
1Gemini 3 Pro45.4
2GPT-5.454.1
3GPT-OSS-120B55.8
4GPT-5.263.2

Interactive version: theaggregate.ai/benchmark?slug=dtap-bench-direct-attacks-research · How It Works · Data refreshed daily, snapshot 2026-09-26.