APEX-Harm - Task Utility - Task-Specific Replacement Runtime Information: leaderboard
Task utility under injection attacks in the APEX-Agents harness: 180 instances derived from 15 finance, consulting and legal tasks. Each run has 150 steps. Scores are 0–1 task-grader means, not attack success or exposure. Eight attack conditions stay separate; the reported overall score is also retained.
Metric: Mean Task Score (0–1). Source: arxiv.org. Saturation forecast: Around January 2027. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.8 Flash (High) | 0.89 | #21 (Gemini 3.8 Flash) |
| 2 | Gemini 3.7 Flash (High) | 0.86 | #24 (Gemini 3.7 Flash) |
| 3 | Claude Sonnet 5 (Max) | 0.82 | #55 (Claude Sonnet 5) |
| 4 | Gemini 3.6 Flash (High) | 0.82 | #50 (Gemini 3.6 Flash) |
| 5 | GPT-6 Astra (Low) | 0.81 | #5 (GPT-6 Astra) |
| 6 | DeepSeek V4 Flash (Max) | 0.8 | #134 (DeepSeek V4 Flash) |
| 7 | Kimi K3 (Max) | 0.79 | #30 (Kimi K3) |
| 8 | GLM-5.3 Flash (Max) | 0.78 | #66 (GLM-5.3 Flash) |
| 9 | Claude Opus 5 (Max) | 0.73 | #12 (Claude Opus 5) |
| 10 | GPT-5.6 Sol (High) | 0.7 | #18 (GPT-5.6 Sol) |
| 11 | GPT-5.6 Terra (High) | 0.57 | #42 (GPT-5.6 Terra) |
| 12 | GPT-5.6 Luna (Low) | 0.41 | #69 (GPT-5.6 Luna) |
No result here: #3 Claude Opus 5.5, #7 Gemini 4 Argon, #8 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=apex-harm-task-utility-task-specific-replacement-runtime-information · How It Works · Data refreshed daily, snapshot 2026-10-16.