rombos_Replete-Coder-Instruct-8B-Merged Benchmark Results

rombos_Replete-Coder-Instruct-8B-Merged — benchmark results

Provider: Other. Released 2024-10-06. Access: Open.

Unified ELO 1378 ± 20, rank #1319 of 1776 rated models, from 15 benchmark results.

Benchmark	Score	Metric	Percentile
Open Korean LLM Leaderboard	515.18	Average Score (%)	88.9
Open LLM Leaderboard - IFEval	53.88	Score	64.6
Open Chinese LLM - GSM8K	47.92	Accuracy (%)	60.4
Open Chinese LLM - WinoGrande	63.69	Accuracy (%)	59.9
Open Chinese LLM - C-Eval Semantic	68.99	Accuracy (%)	47.9
Open LLM Leaderboard - MATH Level 5	7.78	Score	40.1
Open Chinese LLM - CMMLU	51.72	Accuracy (%)	39.6
Open Chinese LLM Leaderboard	54.54	Average Score (%)	33.5
Open LLM Leaderboard - BBH	21.94	Score	32.6
Open Chinese LLM - TruthfulQA MC	51.42	Accuracy (%)	27.9
Open LLM Leaderboard - GPQA	2.57	Score	23.9
Open Chinese LLM - ARC Challenge	46.16	Accuracy (%)	20.5