magnum-v3-27B-kto: benchmark results
Anthracite's KTO-tuned magnum v3 fine-tune of Gemma 2 27B, part of the series aiming to replicate Claude 3 Sonnet/Opus prose quality. Provider: Other. Released 2024-09-06. Access: Open.
Unified ELO 1581 ± 1, rank #361 of 1553 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 51.38 | Average Score (%) | 98.5 |
| Open LLM Leaderboard - GPQA | 14.09 | Score | 89.6 |
| Open LLM Leaderboard - BBH | 41.16 | Score | 80.2 |
| Open LLM Leaderboard - MMLU-Pro | 35.98 | Score | 76.9 |
| Open LLM Leaderboard - IFEval | 56.75 | Score | 68.6 |
| Open LLM Leaderboard - MATH Level 5 | 18.13 | Score | 67.7 |
| Open LLM Leaderboard - MuSR | 9.92 | Score | 49 |
Interactive version: theaggregate.ai/model?slug=magnum-v3-27b-kto · How It Works · Data refreshed daily, snapshot 2026-09-08.