magnum-v4-22B: benchmark results
Anthracite's community magnum v4 fine-tune of Mistral Small Instruct 2409 (22B) aiming to replicate Claude 3 Sonnet/Opus prose quality. Provider: Anthracite. Released 2024-10-20. Access: Open.
Aggregate Rating 1535 ± 44, rank #1890 of 10916 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - GPQA | 32.8 | Score | 79.6 |
| Open LLM Leaderboard - MuSR | 44.08 | Score | 78.6 |
| Open LLM Leaderboard - BBH | 54.86 | Score | 72.8 |
| Open LLM Leaderboard - MATH Level 5 | 20.02 | Score | 70.9 |
| Open LLM Leaderboard - IFEval | 56.29 | Score | 68.2 |
| Open LLM Leaderboard - MMLU-Pro | 38.3 | Score | 67.1 |
| UGI - Writing | 35.22 | Writing Score | 54.8 |
| UGI - Natural Intelligence | 21.94 | NatInt Score | 50 |
| UGI - Willingness (W/10) | 4.8 | W/10 Score | 38 |
| UGI Leaderboard | 27.33 | UGI Score | 23.7 |
Interactive version: theaggregate.ai/model?slug=magnum-v4-22b · How It Works · Data refreshed daily, snapshot 2026-11-08.