SauerkrautLM-UNA-SOLAR-Instruct: benchmark results

Provider: VAGOsolutions. Access: Open.

Unified ELO 1499 ± 20, rank #1243 of 2928 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC271.8MC2 (%) (0-shot)92.2
Open LLM Leaderboard v1 - HellaSwag88.3Normalized accuracy (%) (10-shot)90.8
Open LLM Leaderboard v1 - WinoGrande83.74Accuracy (%) (5-shot)90.5
Open LLM Leaderboard v1 - ARC Challenge70.9Normalized accuracy (%) (25-shot)87.3
Open LLM Leaderboard v1 - MMLU66.15Accuracy (%) (5-shot)86.1
Open LLM Leaderboard v1 - GSM8K64.67Accuracy (%) (5-shot)78.8
Open LLM Leaderboard - GPQA31.12Score68.6
Open LLM Leaderboard - BBH51.66Score57.2
Open LLM Leaderboard - IFEval45.73Score51.1
Open LLM Leaderboard - MMLU-Pro31.53Score42.2
Open LLM Leaderboard - MuSR39.79Score40.3
Open LLM Leaderboard - MATH Level 54.61Score26.1

Interactive version: theaggregate.ai/model?slug=sauerkrautlm-una-solar-instruct · How It Works · Data refreshed daily, snapshot 2026-09-23.