solar-pro-preview-instruct Benchmark Results

solar-pro-preview-instruct — benchmark results

Upstage's Solar Pro preview instruct model (22B, single-GPU). Provider: Upstage. Released 2024-09-09. Access: Open.

Unified ELO 1597 ± 39, rank #479 of 1776 rated models, from 10 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - IFEval	84.16	Score	99.6
Open LLM Leaderboard - BBH	54.82	Score	96.8
Open LLM Leaderboard - GPQA	16.11	Score	92.7
Open LLM Leaderboard - MMLU-Pro	47.48	Score	91.9
Open LLM Leaderboard - MuSR	15.01	Score	81.1
Open LLM Leaderboard - MATH Level 5	22.05	Score	74.8
Open PL LLM - Multiple Choice	47.9	Average Multiple-Choice Score (%)	62.9
Open PL LLM Leaderboard	51.55	Average Score (%)	61.5
Open PL LLM - Generative	54.36	Average Generative Score (%)	59.4
Open PL LLM - RAG	57.64	Average RAG Score (%)	53.1