Defne-llama3.1-8B — benchmark results

Eurdem's Turkish-English fine-tune of Llama 3.1 8B Instruct, trained on ~4M Turkish tokens and merged with SauerkrautLM. Provider: Other. Released 2024-07-29. Access: Open.

Unified ELO 1457 ± 14, rank #966 of 1776 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM Leaderboard485.81Average Score (%)86
Open LLM Leaderboard - MuSR13.54Score74.5
Open LLM Leaderboard - MMLU-Pro31.84Score69
Open LLM Leaderboard - MATH Level 516.01Score63.8
Open LLM Leaderboard - BBH32.82Score63.2
Open LLM Leaderboard - IFEval50.36Score59.6
Open LLM Leaderboard - GPQA6.15Score51.6

Interactive version: theaggregate.ai/model?slug=defne-llama3-1-8b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.