Solar-10.7B-Cato: benchmark results

Provider: Upstage.

Aggregate Rating 1446 ± 34, rank #3952 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU65.76Accuracy (%) (5-shot)85.3
Open LLM Leaderboard v1 - ARC Challenge68.69Normalized accuracy (%) (25-shot)81
Open LLM Leaderboard v1 - HellaSwag86.16Normalized accuracy (%) (10-shot)79.1
Open LLM Leaderboard v1 - GSM8K64.59Accuracy (%) (5-shot)78.6
Open LLM Leaderboard v1 - TruthfulQA MC261.68MC2 (%) (0-shot)78
Open LLM Leaderboard v1 - WinoGrande81.22Accuracy (%) (5-shot)77.8

Interactive version: theaggregate.ai/model?slug=solar-10-7b-cato · How It Works · Data refreshed daily, snapshot 2026-11-08.