naps-llama-3.1-8B-instruct-v0.4 — benchmark results

NAPS-ai's Korean-language LoRA fine-tune of Llama 3.1 8B Instruct, trained on the KOpen-HQ-Hermes-2.5 dataset. Provider: Other. Released 2024-09-12. Access: Open.

Unified ELO 1463 ± 47, rank #945 of 1776 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval73.44Score87.9
Open LLM Leaderboard - MuSR13.96Score76.6
Open LLM Leaderboard - MATH Level 519.64Score70.3
Open Korean LLM Leaderboard330.85Average Score (%)68.8
Open LLM Leaderboard - MMLU-Pro27.5Score50.7
Open LLM Leaderboard - BBH27.83Score44.6
Open LLM Leaderboard - GPQA3.91Score34.3

Interactive version: theaggregate.ai/model?slug=naps-llama-3-1-8b-instruct-v0-4 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.