MegaBeam-Mistral-7B-300k: benchmark results

Provider: Other. Released 2024-05-13. Access: Open.

Unified ELO 1373 ± 1, rank #1212 of 1392 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Chinese LLM - TruthfulQA MC57.78Accuracy (%)74.2
Open LLM Leaderboard - IFEval52.03Score62
Open Korean LLM Leaderboard37.07Average Score (%)57.8
Open LLM Leaderboard - MuSR8.35Score39.6
Open LLM Leaderboard - BBH19.29Score28.8
Open LLM Leaderboard - GPQA3.13Score28.5
Open LLM Leaderboard - MMLU-Pro17.21Score26.2
Open LLM Leaderboard - MATH Level 52.11Score14.7
Open Chinese LLM - WinoGrande59.51Accuracy (%)11.7
Open Chinese LLM - GSM8K14.78Accuracy (%)11
Open Chinese LLM - ARC Challenge41.47Accuracy (%)8.9
Open Chinese LLM Leaderboard43.28Average Score (%)7.7

Interactive version: theaggregate.ai/model?slug=megabeam-mistral-7b-300k · How It Works · Data refreshed daily, snapshot 2026-09-05.