Skywork-o1-Open-Llama-3.1-8B: benchmark results

Provider: Skywork. Released 2024-11-26. Access: Open.

Aggregate Rating 1310 ± 37, rank #8544 of 10916 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MATH Level 552.11Score97.8
Open LLM Leaderboard - BBH45.16Score34.4
Open LLM Leaderboard - IFEval35.18Score33.6
Open LLM Leaderboard - MMLU-Pro20.3Score21.7
Open LLM Leaderboard - GPQA25.92Score11.7
Open Persian LLM - ARC Challenge41.61Accuracy (%)10
Open Persian LLM - ARC Easy47.12Accuracy (%)10
Open Persian LLM - AUT Multiple Choice Persian40.43Accuracy (%)10
Open Persian LLM Leaderboard34.15Average Score (%)10
Open Persian LLM - MMLU Pro14.55Accuracy (%)3.3
Open Persian LLM - Part Multiple Choice27.02Accuracy (%)3.3
Open LLM Leaderboard - MuSR31.56Score0.7

Interactive version: theaggregate.ai/model?slug=skywork-o1-open-llama-3-1-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.