NeuralLLaMa-3-8B-ORPO-v0.4: benchmark results

Provider: Other. Released 2024-05-16. Access: Open.

Aggregate Rating 1410 ± 17, rank #1189 of 1656 rated models, from 23 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GSM8K (flexible extract)49.81Exact match, flexible extract (%)83.8
Open Korean LLM - Ko-IFEval39.7Strict accuracy, prompt/instruction mean (%)81.3
Open Korean LLM Leaderboard39.63Average Score (%)72.8
Open Ko-LLM Leaderboard39.63Average (%)72.6
Open Chinese LLM - GSM8K48.9Accuracy (%)63.5
Open Korean LLM - Ko-GPQA-Diamond24.24Normalized accuracy (%)62.4
Open Portuguese LLM - OAB Exams45.69Accuracy (%)61.9
Open Chinese LLM - TruthfulQA MC54.83Accuracy (%)58.3
Open Korean LLM - Ko-EQ-Bench12.51EQ-Bench score58.3
Open Portuguese LLM - ENEM63.54Accuracy (%)56
Open Chinese LLM - WinoGrande63.38Accuracy (%)55.6
Open Chinese LLM - CMMLU54.23Accuracy (%)55

Interactive version: theaggregate.ai/model?slug=neuralllama-3-8b-orpo-v0-4 · How It Works · Data refreshed daily, snapshot 2026-10-20.