Llama-3.1-Nemotron-lorablated-70B Benchmark Results

Llama-3.1-Nemotron-lorablated-70B: benchmark results

mlabonne's LoRA-ablated (uncensored) merge of Llama 3.1 Nemotron 70B. Provider: nbeerbower. Released 2024-10-17. Access: Open.

Aggregate Rating 1644 ± 49, rank #658 of 10916 rated models, from 10 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - GPQA	39.09	Score	97.5
Open LLM Leaderboard - BBH	68.25	Score	96.6
Open LLM Leaderboard - MMLU-Pro	53.43	Score	93.7
Open LLM Leaderboard - MuSR	46.82	Score	90.6
Open LLM Leaderboard - IFEval	72.29	Score	86.2
Open LLM Leaderboard - MATH Level 5	33.38	Score	84.2
UGI Leaderboard	47.35	UGI Score	83.4
UGI - Willingness (W/10)	7.5	W/10 Score	78.3
UGI - Writing	42.05	Writing Score	77.8
UGI - Natural Intelligence	30.29	NatInt Score	72.9