Cohere Command A Report - Safety Modes - Strict: leaderboard
Same test under Cohere's "strict" safety-mode instruction, which forbids more topics; the number is the mean of the answer and refuse success rates. Differs from the contextual board only in the policy given.
Metric: Safety-mode accuracy (%, higher is better). Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.5 Sonnet | 89.6 | #746 |
| 2 | Command A | 87.5 | #1274 |
| 3 | GPT-4o | 86.9 | #741 |
| 4 | Gemma 2 9B (IT) | 81.8 | #2262 |
| 5 | Llama 3.1 8B Instruct | 81 | #4246 |
| 6 | Llama 3.1 405B Instruct | 80.5 | #1115 |
| 7 | Gemini 2.0 Flash | 79 | #704 |
| 8 | Qwen 2.5 72B Instruct | 78.3 | #1092 |
| 9 | Qwen 2.5 7B Instruct | 74.7 | #2564 |
| 10 | Command-R+ (08-2024) | 70 | #2551 |
| 11 | DeepSeek V3 | 68.7 | #716 |
| 12 | c4ai-command-r-08-2024 | 68 | #3374 |
| 13 | Llama 3.3 70B Instruct | 67.9 | #1357 |
| 14 | Command R7B | 62.3 | #7513 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=cohere-command-a-report-safety-modes-strict · How It Works · Data refreshed daily, snapshot 2026-11-13.