CI-Work - Violation Rate: leaderboard
Metric: Violation rate (%): share of cases whose final action discloses at least one sensitive entry, mean of the five information-flow directions, on CI-Work enterprise scenarios (125 seeds, 25 per information-flow direction, each with 4 sensitive and 4 essential entries retrieved through simulated email, chat, calendar and meeting tools), ReAct agent, disclosure judged per entry by a GPT-5.2 judge (83 to 91 percent agreement with human labels); lower is better. Source: arxiv.org. Saturation forecast: Around January 2027. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o | 21.33 |
| 2 | GPT-4.1 | 25.91 |
| 3 | GPT-5 | 27.83 |
| 4 | O3 | 32.2 |
Interactive version: theaggregate.ai/benchmark?slug=ci-work-violation-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.