llama3-pre1-pre2-inst3-ds-lora3.1 Benchmark Results

llama3-pre1-pre2-inst3-ds-lora3.1: benchmark results

Provider: Meta. Access: Open.

Unified ELO 1281 ± 17, rank #2515 of 2656 rated models, from 10 benchmark results.

Benchmark	Score	Metric	Percentile
Open Korean LLM - Ko-EQ-Bench	0	EQ-Bench score	24.5
Open Korean LLM - Ko-GPQA-Diamond	20.71	Normalized accuracy (%)	18.8
Open Korean LLM - Ko-IFEval	19.29	Strict accuracy, prompt/instruction mean (%)	15.6
Open Korean LLM - KorNAT-CKA	16.61	Normalized accuracy (%)	12.5
Open Ko-LLM Leaderboard	27.99	Average (%)	3.9
Open Korean LLM Leaderboard	27.99	Average Score (%)	3.9
Open Korean LLM - KorNAT-Helpful	38.3	Normalized accuracy (%)	3.4
Open Korean LLM - KorNAT-Harmless	58.12	Normalized accuracy (%)	2.6
Open Korean LLM - Ko-GSM8K (flexible extract)	0	Exact match, flexible extract (%)	2
Open Korean LLM - Ko-Winogrande	47.91	Accuracy (%)	0.3