magnum-v2-12B: benchmark results
Anthracite's magnum v2 fine-tune of Mistral Nemo Base 2407 (12B), aimed at replicating the prose quality of Claude 3 Sonnet and Opus. Provider: Anthracite. Released 2024-08-03. Access: Open.
Aggregate Rating 1464 ± 47, rank #3109 of 10916 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MuSR | 41.79 | Score | 58.2 |
| Open LLM Leaderboard - BBH | 50.21 | Score | 49.2 |
| UGI - Writing | 32.97 | Writing Score | 46.8 |
| Open LLM Leaderboard - GPQA | 29.11 | Score | 46 |
| Open LLM Leaderboard - MMLU-Pro | 31.67 | Score | 42.7 |
| Open LLM Leaderboard - IFEval | 37.62 | Score | 36.7 |
| Open LLM Leaderboard - MATH Level 5 | 5.44 | Score | 30.2 |
| UGI - Willingness (W/10) | 3.2 | W/10 Score | 25.4 |
| UGI - Natural Intelligence | 15.74 | NatInt Score | 21.8 |
| UGI Leaderboard | 21.54 | UGI Score | 13.9 |
Interactive version: theaggregate.ai/model?slug=magnum-v2-12b · How It Works · Data refreshed daily, snapshot 2026-11-08.