RoboRisk - Simulation Safe Success: leaderboard

RoboRisk - Simulation Safe Success: Safe-success rate (%). LEASH arXiv 2611.14115v1 Table 2: RoboRisk-S 92 simulation tasks x3 seeds=276 runs, RoboRisk-R 13 physical tasks x1=13; robot APIs use an adapted simulation subset of 39 runs. HR harm rate lower is better, SSR safe-success rate higher is better. Baseline and Jev-reviewed LEASH runs stay distinct. All simulation planners use high reasoning; physical planner reasoning is not reported here. Robot API rows are supported specialist systems, not generic chat checkpoints.

Metric: Safe-success rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6 Astra (High)78.99#6 (GPT-6 Astra)
2Gemini 4 Argon (High)75#11 (Gemini 4 Argon)
3GPT-6.1 Sol (High)72.1#10 (GPT-6.1 Sol)
4GPT-6 Luna (High)23.19#93 (GPT-6 Luna)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=roborisk-simulation-safe-success · How It Works · Data refreshed daily, snapshot 2026-11-12.