SycoBench-600 - Authority: leaderboard
The user invokes a trusted authority to challenge the model's correct multiple-choice answer; the score is the share of correct answers it then changes to a wrong one. The paper finds this the strongest pressure for most models.
Metric: Flip-to-wrong rate (%, lower is better). Source: aclanthology.org. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 4 Maverick Instruct | 5.6 | #1133 |
| 2 | Gemini 2.5 Flash | 11.7 | #453 |
| 3 | GPT-4o | 21.6 | #741 |
| 4 | Claude Sonnet 4 | 28.7 | #400 |
| 5 | Claude 3.5 Haiku | 47.7 | #1553 |
| 6 | Mistral 7B Instruct (v0.3) | 50.3 | #6653 |
| 7 | GPT-4o Mini | 62 | #1623 |
Interactive version: theaggregate.ai/benchmark?slug=sycobench-600-authority · How It Works · Data refreshed daily, snapshot 2026-11-13.