MegaBeam-Mistral-7B-512k Benchmark Results

MegaBeam-Mistral-7B-512k — benchmark results

Provider: Other. Released 2024-07-30. Access: Open.

Unified ELO 1344 ± 21, rank #1433 of 1776 rated models, from 15 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard - IFEval	59.73	Score	71.6
Open Korean LLM Leaderboard	312.34	Average Score (%)	67.4
Open LLM Leaderboard - MuSR	8.52	Score	40.8
Open LLM Leaderboard - GPQA	4.36	Score	37.6
Open Chinese LLM - TruthfulQA MC	51.61	Accuracy (%)	29.8
Open LLM Leaderboard - MMLU-Pro	17.65	Score	26.9
Open Chinese LLM - WinoGrande	61.17	Accuracy (%)	23.4
Open LLM Leaderboard - BBH	12.36	Score	21.4
Open LLM Leaderboard - MATH Level 5	2.87	Score	18.2
Open Chinese LLM - GSM8K	19.26	Accuracy (%)	13.4
Open Chinese LLM - ARC Challenge	41.55	Accuracy (%)	9.5
Open Chinese LLM - CMMLU	43.63	Accuracy (%)	8.9