ToolPrivacyBench - Synthetic-private - Forbidden Disclosure: leaderboard
Private-atom disclosure to unauthorized tools or sinks. Executed multi-tool workflows with purpose-bound privacy policies. Paper v1 Tables 7-8 separately report 1,000 public-derived cases and 1,150 synthetic-private cases. Task success is reported alongside leakage; these are not a new composite score. This series reports Forbidden Over-disclosure Rate (%). Source: https://arxiv.org/html/2606.28061v1.
Metric: Forbidden Over-disclosure Rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.5 Flash | 16.5 | #66 |
| 2 | GPT-5.5 | 18.4 | #33 |
| 3 | Claude Opus 4.7 | 18.5 | #51 |
| 4 | MiniMax-M2.7 | 23.58 | #270 |
| 5 | DeepSeek V4 Flash | 26.67 | #155 |
| 6 | Qwen 3.6 Plus | 27.26 | #124 |
| 7 | Kimi K2.5 | 27.77 | #152 |
| 8 | GLM-5.1 | 28.58 | #109 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=toolprivacybench-synthetic-private-forbidden-disclosure · How It Works · Data refreshed daily, snapshot 2026-11-05.