Llama-3.1-Nemotron-lorablated-70B Benchmark Results

Llama-3.1-Nemotron-lorablated-70B: benchmark results

mlabonne's LoRA-ablated (uncensored) merge of Llama 3.1 Nemotron 70B. Provider: NVIDIA. Released 2024-10-17. Access: Open.

Unified ELO 1603 ± 1, rank #259 of 1392 rated models, from 10 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - GPQA	18.79	Score	97.5
Open LLM Leaderboard - BBH	54.18	Score	96.5
Open LLM Leaderboard - MMLU-Pro	48.26	Score	93.7
Open LLM Leaderboard - MuSR	18.35	Score	90.7
Open LLM Leaderboard - IFEval	72.29	Score	86.2
UGI Leaderboard	47.35	UGI Score	84.6
Open LLM Leaderboard - MATH Level 5	33.38	Score	84.1
UGI - Writing	42.05	Writing Score	79.3
UGI - Willingness (W/10)	7.5	W/10 Score	77.9
UGI - Natural Intelligence	30.29	NatInt Score	74.3