Llama 3 8B ProLong 512k Base: benchmark results

Provider: Meta. Released 2024-08-22. Access: Open.

Unified ELO 1462 ± 1, rank #889 of 1392 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard42.97Average Score (%)85.2
Open LLM Leaderboard - MuSR12.68Score69.5
Open LLM Leaderboard - IFEval53.22Score63.3
Open LLM Leaderboard - BBH29.85Score51.1
Open LLM Leaderboard - MMLU-Pro25.88Score46.8
Open Chinese LLM - CMMLU52.86Accuracy (%)44.5
Open Chinese LLM - WinoGrande62.19Accuracy (%)37.8
Open LLM Leaderboard - MATH Level 56.87Score36.9
Open Chinese LLM - C-Eval Semantic62.86Accuracy (%)32
Open Chinese LLM - GSM8K34.19Accuracy (%)28.5
Open Chinese LLM - HellaSwag56.14Accuracy (%)28.5
Open Chinese LLM - TruthfulQA MC51.27Accuracy (%)26.7

Interactive version: theaggregate.ai/model?slug=llama-3-8b-prolong-512k-base · How It Works · Data refreshed daily, snapshot 2026-09-05.