rombos_Replete-Coder-Instruct-8B-Merged Benchmark Results

rombos_Replete-Coder-Instruct-8B-Merged: benchmark results

Provider: Other. Released 2024-10-06. Access: Open.

Unified ELO 1436 ± 1, rank #1010 of 1392 rated models, from 15 benchmark results.

Benchmark	Score	Metric	Percentile
Open Korean LLM Leaderboard	44.97	Average Score (%)	90.7
Open LLM Leaderboard - IFEval	53.88	Score	64.6
Open Chinese LLM - GSM8K	47.92	Accuracy (%)	60.4
Open Chinese LLM - WinoGrande	63.69	Accuracy (%)	59.9
Open Chinese LLM - C-Eval Semantic	68.99	Accuracy (%)	47.9
Open LLM Leaderboard - MATH Level 5	7.78	Score	40.1
Open Chinese LLM - CMMLU	51.72	Accuracy (%)	39.6
Open Chinese LLM Leaderboard	54.54	Average Score (%)	33.5
Open LLM Leaderboard - BBH	21.94	Score	32.7
Open Chinese LLM - TruthfulQA MC	51.42	Accuracy (%)	27.9
Open LLM Leaderboard - GPQA	2.57	Score	23.9
Open Chinese LLM - ARC Challenge	46.16	Accuracy (%)	20.5