SciHazard (Science-Specific Models) - Harm When Not Refused: leaderboard
SciHazard (Shanghai AI Laboratory, 2026) measures scientific misuse risk with 2,400 hazardous questions grounded in regulated substances and documented misuse scenarios across 12 disciplines, plus 600 benign questions that reuse the same trigger words. This board averages the DeHarm-Score over answers that were not refused, on a 0 to 5 scale where lower is safer; it covers science-specific models and agents.
Metric: DeHarm-Score over non-refused answers (0-5, lower is safer; the mean over the non-refused answers to 2,400 hazardous questions in 12 scientific disciplines of hazard level 1 to 5 x (executability + net-new risk, each 1 to 4)/8, executability from importance-weighted checklists and net-new risk from retrieval-checked claims, judged by Qwen3.5-35B-A3B; proprietary science-specific models and agents). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | InternAgent | 2.22 | |
| 2 | S1-VL-32B | 2.68 | |
| 3 | Intern-S1-Pro | 2.76 | #573 |
Interactive version: theaggregate.ai/benchmark?slug=scihazard-science-specific-models-harm-when-not-refused · How It Works · Data refreshed daily, snapshot 2026-11-13.