magnum-v3-27B-kto — benchmark results
Anthracite's KTO-tuned magnum v3 fine-tune of Gemma 2 27B, part of the series aiming to replicate Claude 3 Sonnet/Opus prose quality. Provider: Other. Released 2024-09-06. Access: Open.
Unified ELO 1533 ± 37, rank #676 of 1776 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 686.77 | Average Score (%) | 95.7 |
| Open LLM Leaderboard - GPQA | 14.09 | Score | 89.6 |
| Open LLM Leaderboard - BBH | 41.16 | Score | 80.2 |
| Open LLM Leaderboard - MMLU-Pro | 35.98 | Score | 77 |
| Open LLM Leaderboard - IFEval | 56.75 | Score | 68.6 |
| Open LLM Leaderboard - MATH Level 5 | 18.13 | Score | 67.7 |
| Open LLM Leaderboard - MuSR | 9.92 | Score | 49 |
Interactive version: theaggregate.ai/model?slug=magnum-v3-27b-kto · How the rankings work · Data refreshed daily, snapshot 2026-07-22.