ToolPrivacyBench - Public-derived - Forbidden Disclosure: leaderboard

Private-atom disclosure to unauthorized tools or sinks. Executed multi-tool workflows with purpose-bound privacy policies. Paper v1 Tables 7-8 separately report 1,000 public-derived cases and 1,150 synthetic-private cases. Task success is reported alongside leakage; these are not a new composite score. This series reports Forbidden Over-disclosure Rate (%). Source: https://arxiv.org/html/2606.28061v1.

Metric: Forbidden Over-disclosure Rate (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.510.21#33
2Claude Opus 4.710.91#51
3Kimi K2.511.01#152
4Qwen 3.6 Plus13.15#124
5MiniMax-M2.713.19#270
6DeepSeek V4 Flash14.71#155
7Gemini 3.5 Flash15.15#66
8GLM-5.118.77#109

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=toolprivacybench-public-derived-forbidden-disclosure · How It Works · Data refreshed daily, snapshot 2026-11-05.