Starling-LM-7B-alpha-ExPO: benchmark results

Provider: UC Berkeley. Released 2024-04-26. Access: Open.

Aggregate Rating 1410 ± 24, rank #5620 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K61.56Accuracy (%) (5-shot)74.3
Open LLM Leaderboard v1 - MMLU64.64Accuracy (%) (5-shot)74
Open LLM Leaderboard v1 - WinoGrande80.35Accuracy (%) (5-shot)73.5
Open LLM Leaderboard v1 - HellaSwag84.79Normalized accuracy (%) (10-shot)68.6
Open LLM Leaderboard v1 - ARC Challenge63.91Normalized accuracy (%) (25-shot)64.8
AlpacaEval 2.019.47LC Win Rate (%)49.1
Open Chinese LLM - GSM8K37.53Accuracy (%)34.9
Open LLM Leaderboard v1 - TruthfulQA MC246.38MC2 (%) (0-shot)34.3
Open Chinese LLM - TruthfulQA MC50.86Accuracy (%)23.7
Open Chinese LLM Leaderboard51.28Official Nonzero-Task Mean (%)21.6
Open Chinese LLM - ARC Challenge46.25Accuracy (%)21
Open Chinese LLM - HellaSwag53.32Accuracy (%)14.5

Interactive version: theaggregate.ai/model?slug=starling-lm-7b-alpha-expo · How It Works · Data refreshed daily, snapshot 2026-11-08.