ToolPrivacyBench - Synthetic-private - Severity-weighted Leakage: leaderboard
Leakage weighted by private-atom severity. Executed multi-tool workflows with purpose-bound privacy policies. Paper v1 Tables 7-8 separately report 1,000 public-derived cases and 1,150 synthetic-private cases. Task success is reported alongside leakage; these are not a new composite score. This series reports Severity-weighted Leakage Rate (%). Source: https://arxiv.org/html/2606.28061v1.
Metric: Severity-weighted Leakage Rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.5 Flash | 18.5 | #66 |
| 2 | Claude Opus 4.7 | 18.55 | #51 |
| 3 | GPT-5.5 | 19.41 | #33 |
| 4 | MiniMax-M2.7 | 25.95 | #270 |
| 5 | DeepSeek V4 Flash | 28.78 | #155 |
| 6 | Qwen 3.6 Plus | 28.82 | #124 |
| 7 | Kimi K2.5 | 29.9 | #152 |
| 8 | GLM-5.1 | 30.48 | #109 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=toolprivacybench-synthetic-private-severity-weighted-leakage · How It Works · Data refreshed daily, snapshot 2026-11-05.