Cydonia-22B-v1.2: benchmark results

TheDrummer's roleplay and creative-writing tune of Mistral Small 22B. Provider: BeaverAI. Released 2024-10-07. Access: Open.

Aggregate Rating 1512 ± 52, rank #2056 of 10870 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - GPQA33.05Score80.7
Open LLM Leaderboard - BBH58.09Score79.2
Open LLM Leaderboard - MMLU-Pro41.41Score75.4
Open LLM Leaderboard - MATH Level 520.32Score71.5
Open LLM Leaderboard - IFEval56.35Score68.3
Open LLM Leaderboard - MuSR40.22Score44
StickToYourRole56.6Cardinal Score38.7
Stick To Your Role!0.57Cardinal Score (-1 to 1)36.7
Stick To Your Role! - Rank-Order Stability0.49Rank-Order Stability (correlation, -1 to 1)36.7

Interactive version: theaggregate.ai/model?slug=cydonia-22b-v1-2 · How It Works · Data refreshed daily, snapshot 2026-11-12.