AgentHazard (IFlow) - System RCE: leaderboard

AgentHazard attack success rate on system remote code execution (RCE) attempts (arbitrary system command execution on the host or container), with each backbone model running inside IFlow. Percent of instances judged harmful on the full trajectory by Gemini-3-Flash, lower is better.

Metric: Attack success rate (%) on the system remote code execution (RCE) instances (arbitrary system command execution on the host or container), with the model running inside the IFlow workflow-orchestration agent framework (built-in tool routing and execution control), over AgentHazard instances (harmful objectives embedded in locally legitimate multi-step workflows, ten risk categories and ten attack strategies; the evaluated runs cover 1,000 instances), judged on the full trajectory (round_all) by Gemini-3-Flash, which labels a trajectory harmful when it realizes the objective; backbones served through an OpenAI-compatible API; lower is better. Source: arxiv.org. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1IFlow + Qwen2.5-Coder-32B-Instruct76
2IFlow + Qwen3-32B85
3IFlow + Qwen2.5-72B-Instruct86
4IFlow + Qwen3-VL-235B-A22B-Instruct88
5IFlow + Kimi-K2.589
6IFlow + Kimi-K289
7IFlow + GLM-4.693

Interactive version: theaggregate.ai/benchmark?slug=agenthazard-iflow-system-rce · How It Works · Data refreshed daily, snapshot 2026-11-21.