Configurable-Llama-3.1-8B-Instruct — benchmark results

vicgalle's configurable-safety-tuning research fine-tune of Llama 3.1 8B Instruct, letting system prompts set safety behavior at inference time. Provider: Other. Released 2024-07-24. Access: Open.

Unified ELO 1462 ± 41, rank #949 of 1776 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval83.12Score99.3
Open Korean LLM Leaderboard417.52Average Score (%)78.9
Open LLM Leaderboard - MATH Level 517.3Score66.1
Open LLM Leaderboard - MMLU-Pro28.8Score54.5
Open LLM Leaderboard - BBH29.66Score50.5
UGI - Natural Intelligence18.19NatInt Score33.4
Open LLM Leaderboard - GPQA3.24Score29.4
Open LLM Leaderboard - MuSR5.93Score28.6
UGI - Willingness (W/10)3.2W/10 Score24.1
UGI - Writing24.96Writing Score22.2
UGI Leaderboard20.43UGI Score12.2

Interactive version: theaggregate.ai/model?slug=configurable-llama-3-1-8b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.