TIER (Llama-3.1-8B-Instruct Judge) - Jailbreak: leaderboard
Metric: Attack success rate (%; L4 jailbreak prompts: in-the-wild jailbreaks, Caesar-cipher transformations and multilingual red-teaming prompts, 296 prompts over four risk areas; share of prompts whose response Llama-3.1-8B-Instruct labels harmful compliance (label 5 of a six-label behavior scale), greedy decoding with the default chat configuration). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | gpt-j-6B | 13.9 |
Interactive version: theaggregate.ai/benchmark?slug=tier-llama-3-1-8b-instruct-judge-jailbreak · How It Works · Data refreshed daily, snapshot 2026-09-26.