SciHazard (Deep Research Agents) - Oversafety: leaderboard
Metric: Over-refusal rate (%; share of 600 benign defence, detection and emergency-response questions that reuse hazardous trigger words and are refused; lower is better; deep-research agents and agent frameworks with web retrieval at provider defaults). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O3 Deep Research | 0 |
| 2 | Sonar Pro | 5 |
Interactive version: theaggregate.ai/benchmark?slug=scihazard-deep-research-agents-oversafety · How It Works · Data refreshed daily, snapshot 2026-09-29.