AgentTrap: leaderboard

Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents, and service configuration into reusable workflows. This makes skills useful, but it also introduces a new security problem: a malicious skill does not need to ask the model to perform an obviously harmful action. Instead, it can disguise the harmfu

Metric: Attack success (self-reported). Source: benchmarklist.com. Saturation forecast: Not forecast. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.633#90
2Hy3-preview48#157
3GPT-5.3 Codex55#69
4Qwen3 Coder Next58#326
5GPT-5.4 Mini64#212
6GLM-5.173#97
7Kimi K2.675#104

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=agenttrap · How It Works · Data refreshed daily, snapshot 2026-10-20.