Llama 3 8B ProLong 64k Base: benchmark results

Princeton NLP's Llama-3-8B ProLong 64K Base, continued-pretrained from Llama 3 8B Instruct for long-context ability, one checkpoint in the ProLong family that scales up to 512K context. Provider: Princeton NLP. Released 2024-07-22. Access: Open.

Aggregate Rating 1432 ± 17, rank #1091 of 1656 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard42.62Average Score (%)86.7
Open Ko-LLM Leaderboard42.62Average (%)86.6
Open Korean LLM - Ko-GPQA-Diamond25.76Normalized accuracy (%)81.3
Open Korean LLM - Ko-EQ-Bench31.09EQ-Bench score80.2
Open Portuguese LLM - ASSIN2 RTE92.44Macro F1 (%)79
Open Korean LLM - Ko-GSM8K (flexible extract)42.68Exact match, flexible extract (%)78
Open Korean LLM - Ko-IFEval36.24Strict accuracy, prompt/instruction mean (%)75.3
Open LLM Leaderboard - MuSR43.41Score73.7
Open Portuguese LLM - OAB Exams48.66Accuracy (%)70.5
Open Portuguese LLM - ENEM68.02Accuracy (%)68.4
Open Portuguese LLM - FaQuAD NLI72.26Macro F1 (%)65.1
Open Korean LLM - KorNAT-Helpful48.05Normalized accuracy (%)63.9

Interactive version: theaggregate.ai/model?slug=llama-3-8b-prolong-64k-base · How It Works · Data refreshed daily, snapshot 2026-10-20.