romulus-mistral-nemo-12B-simpo — benchmark results
Axolotl AI's SimPO preference-optimization fine-tune of Mistral Nemo 12B, trained on Princeton's gemma2-ultrafeedback-armorm pairs. Provider: Other. Released 2024-07-24. Access: Open.
Unified ELO 1522 ± 70, rank #715 of 1776 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Korean LLM Leaderboard | 767.43 | Average Score (%) | 97.3 |
| Open LLM Leaderboard - IFEval | 60.79 | Score | 72.8 |
| Open LLM Leaderboard - MuSR | 12.98 | Score | 71.3 |
| Open LLM Leaderboard - BBH | 34.64 | Score | 69.1 |
| Open LLM Leaderboard - MATH Level 5 | 11.4 | Score | 51.8 |
| Open LLM Leaderboard - MMLU-Pro | 27.43 | Score | 50.4 |
| Open LLM Leaderboard - GPQA | 3.8 | Score | 33.5 |
Interactive version: theaggregate.ai/model?slug=romulus-mistral-nemo-12b-simpo · How the rankings work · Data refreshed daily, snapshot 2026-07-22.