Llama 3.1 8B MultiReflection Instruct: benchmark results

leafspark's LoRA fine-tune of Llama 3.1 8B Instruct on synthetic reflection data to mimic o1-style structured multi-step reasoning. Provider: leafspark. Released 2024-09-15. Access: Open.

Aggregate Rating 1447 ± 19, rank #1019 of 1661 rated models, from 21 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-IFEval48.8Strict accuracy, prompt/instruction mean (%)92.7
Open Korean LLM - Ko-EQ-Bench38.4EQ-Bench score89.4
Open LLM Leaderboard - IFEval71.25Score84.6
Open Ko-LLM Leaderboard41.87Average (%)83.8
Open Korean LLM Leaderboard41.87Average Score (%)83.8
Open Portuguese LLM - ASSIN2 RTE92.07Macro F1 (%)73.9
Open Portuguese LLM - OAB Exams48.97Accuracy (%)71.2
Open Korean LLM - Ko-GPQA-Diamond24.75Normalized accuracy (%)69.5
Open Portuguese LLM - ENEM68.09Accuracy (%)68.7
Open Portuguese LLM - BLUEX56.33Accuracy (%)65.9
Open LLM Leaderboard - MATH Level 517.07Score65.6
Open LLM Leaderboard - MMLU-Pro37.24Score61.3

Interactive version: theaggregate.ai/model?slug=llama-3-1-8b-multireflection-instruct · How It Works · Data refreshed daily, snapshot 2026-10-23.