MN-LooseCannon-12B-v1: benchmark results

GalrionSoftworks' TIES merge of Starcannon v3 and Lyra v1, two roleplay-oriented Mistral Nemo 12B tunes. Provider: GalrionSoftworks. Released 2024-08-09. Access: Open.

Aggregate Rating 1512 ± 50, rank #2157 of 10916 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval54.18Score65
UGI - Writing37.49Writing Score62.4
Open LLM Leaderboard - BBH51.28Score55.3
Open LLM Leaderboard - MuSR41.38Score53.9
UGI - Natural Intelligence22.82NatInt Score52.7
Open LLM Leaderboard - MMLU-Pro31.96Score43.7
Open LLM Leaderboard - MATH Level 58.53Score42.7
Open LLM Leaderboard - GPQA28.52Score40.2
UGI - Willingness (W/10)4.8W/10 Score38
UGI Leaderboard31.13UGI Score34.5

Interactive version: theaggregate.ai/model?slug=mn-loosecannon-12b-v1 · How It Works · Data refreshed daily, snapshot 2026-11-08.