ToolPrivacyBench - Public-derived - Severity-weighted Leakage: leaderboard
Leakage weighted by private-atom severity. Executed multi-tool workflows with purpose-bound privacy policies. Paper v1 Tables 7-8 separately report 1,000 public-derived cases and 1,150 synthetic-private cases. Task success is reported alongside leakage; these are not a new composite score. This series reports Severity-weighted Leakage Rate (%). Source: https://arxiv.org/html/2606.28061v1.
Metric: Severity-weighted Leakage Rate (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.5 | 10.08 | #33 |
| 2 | Claude Opus 4.7 | 11.53 | #51 |
| 3 | Kimi K2.5 | 12.42 | #152 |
| 4 | Qwen 3.6 Plus | 13.69 | #124 |
| 5 | MiniMax-M2.7 | 14.71 | #270 |
| 6 | Gemini 3.5 Flash | 16.84 | #66 |
| 7 | DeepSeek V4 Flash | 17.18 | #155 |
| 8 | GLM-5.1 | 20.23 | #109 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=toolprivacybench-public-derived-severity-weighted-leakage · How It Works · Data refreshed daily, snapshot 2026-11-05.