Llama 3 8B ProLong 64k Instruct — benchmark results

Princeton NLP's ProLong 64K, Llama 3 8B Instruct continued-trained on 20B tokens of long-context data and SFT'd on UltraChat. Provider: Meta. Released 2024-07-21. Access: Open.

Unified ELO 1416 ± 12, rank #1151 of 1776 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard494.55Average Score (%)86.9
Open LLM Leaderboard - MuSR14.6Score79.4
Open LLM Leaderboard - IFEval55.63Score67.4
Open Chinese LLM - TruthfulQA MC54.3Accuracy (%)55.9
Open LLM Leaderboard - BBH30.09Score52.1
Open LLM Leaderboard - GPQA6.04Score50.7
Open LLM Leaderboard - MMLU-Pro25.27Score45.3
Open Chinese LLM - GSM8K42.08Accuracy (%)42.6
Open Chinese LLM - ARC Challenge50.09Accuracy (%)41.4
Open Chinese LLM - C-Eval Semantic66.58Accuracy (%)40.9
Open Chinese LLM - CMMLU51.63Accuracy (%)38.9
Open Chinese LLM - HellaSwag58.22Accuracy (%)38.7

Interactive version: theaggregate.ai/model?slug=llama-3-8b-prolong-64k-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.