Llama 3 8B Instruct: benchmark results

Meta Llama 3 8B instruction-tuned checkpoint. Provider: Meta. Released 2024-04-18. Access: Open.

Aggregate Rating 1424 ± 5, rank #1129 of 1656 rated models, from 1240 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FinSafetyBench (FlipAttack) - Ethical Violations (Chinese)32.05Attack success rate (%; FlipAttack jailbreak; share of the b100
FinSafetyBench (PAIR) - Ethical Violations (Chinese)61.69Attack success rate (%; PAIR jailbreak; share of the benchma100
FinSafetyBench (PAIR) - Ethical Violations (English)45.34Attack success rate (%; PAIR jailbreak; share of the benchma100
FinSafetyBench (PAIR) - Financial Crimes (Chinese)78.58Attack success rate (%; PAIR jailbreak; share of the benchma100
FinSafetyBench (PAIR) - Financial Crimes (English)34.79Attack success rate (%; PAIR jailbreak; share of the benchma100
FinSafetyBench (ReNeLLM) - Ethical Violations (Chinese)33.97Attack success rate (%; ReNeLLM jailbreak; share of the benc100
FinSafetyBench (ReNeLLM) - Ethical Violations (English)48.35Attack success rate (%; ReNeLLM jailbreak; share of the benc100
FinSafetyBench (ReNeLLM) - Financial Crimes (Chinese)39.72Attack success rate (%; ReNeLLM jailbreak; share of the benc100
FinSafetyBench (ReNeLLM) - Financial Crimes (English)32.91Attack success rate (%; ReNeLLM jailbreak; share of the benc100
FinSafetyBench - Ethical Violations (Chinese)42.57Attack success rate (%; mean over the PAIR, ReNeLLM and Flip100
FinSafetyBench - Ethical Violations (English)40.56Attack success rate (%; mean over the PAIR, ReNeLLM and Flip100
FinSafetyBench - Financial Crimes (Chinese)52.65Attack success rate (%; mean over the PAIR, ReNeLLM and Flip100

Interactive version: theaggregate.ai/model?slug=llama-3-8b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.