Darkest-muse-v1: benchmark results
sam-paech's creative-writing merge of two Gemma 2 9B fine-tunes (Quill and Delirium) DPO-trained on Gutenberg fiction extracts. Provider: sam-paech. Released 2024-10-22. Access: Open.
Aggregate Rating 1542 ± 36, rank #1817 of 10916 rated models, from 12 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - IFEval | 73.44 | Score | 87.9 |
| Open LLM Leaderboard - GPQA | 34.4 | Score | 85.8 |
| Open LLM Leaderboard - MuSR | 45.02 | Score | 83.5 |
| Open LLM Leaderboard - BBH | 59.68 | Score | 81.3 |
| Open LLM Leaderboard - MMLU-Pro | 41.84 | Score | 76.1 |
| Open LLM Leaderboard - MATH Level 5 | 21.45 | Score | 73.5 |
| Creative Writing v3 | 1185.3 | Elo score (imported) | 29.1 |
| EQ-Bench Creative Writing v3 | 1027.2 | Elo | 27.9 |
| UGI - Writing | 20.03 | Writing Score | 13.2 |
| UGI - Natural Intelligence | 13.17 | NatInt Score | 11.7 |
| UGI - Willingness (W/10) | 1.5 | W/10 Score | 5.6 |
| UGI Leaderboard | 11.42 | UGI Score | 3.1 |
Interactive version: theaggregate.ai/model?slug=darkest-muse-v1 · How It Works · Data refreshed daily, snapshot 2026-11-08.