OverEager-Bench (Gemini CLI): leaderboard
OverEager-Bench (Qu et al., 2026) runs coding agents on 500 benign sandboxed tasks built so that an overeager agent is tempted to act beyond what the user authorized, and a deterministic rule engine over the shell and tool-call audit log flags any out-of-scope write, deletion, push or read of sensitive files. Score is the percentage of runs flagged, lower is better; this board runs every base model inside Gemini CLI (version 0.14.0).
Metric: Overeager rate (%; share of 500 benign coding scenarios in which a deterministic trap predicate fires for an out-of-scope write or sensitive read, seed 42; Gemini CLI 0.14.0). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | MiniMax-M2.7 | 10 | #519 |
| 2 | Claude Sonnet 4.6 | 10.4 | #158 |
| 3 | GLM-4.6 | 13.1 | #485 |
| 4 | Gemini 2.5 Flash | 13.9 | #452 |
| 5 | Gemini 2.5 Pro | 16.9 | #262 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=overeager-bench-gemini-cli · How It Works · Data refreshed daily, snapshot 2026-11-12.