Llama-3SOME-8B-v2: benchmark results

TheDrummer's (BeaverAI) NSFW roleplay fine-tune of Llama 3 8B, the v2 of his 3SOME series tuned for adult creative writing. Provider: Meta. Released 2024-06-21. Access: Open.

Aggregate Rating 1468 ± 46, rank #2889 of 10916 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MMLU-Pro37.53Score62.6
Open LLM Leaderboard - BBH52.03Score59.2
Open LLM Leaderboard - GPQA30.2Score58.3
Open LLM Leaderboard - IFEval45.08Score49.5
Open LLM Leaderboard - MATH Level 59.37Score45.3
UGI - Writing29.48Writing Score34.2
Open LLM Leaderboard - MuSR38.33Score31.3
UGI - Willingness (W/10)3.8W/10 Score29.3
UGI - Natural Intelligence14.31NatInt Score15.7
UGI Leaderboard19.18UGI Score10.2

Interactive version: theaggregate.ai/model?slug=llama-3some-8b-v2 · How It Works · Data refreshed daily, snapshot 2026-11-08.