mera-mix-4x7B: benchmark results

meraGPT's 4-expert Mixtral-style MoE pitched as a half-size, faster drop-in replacement for Mixtral-8x7B at comparable benchmark scores. Provider: meraGPT. Released 2024-04-13. Access: Open.

Aggregate Rating 1463 ± 23, rank #919 of 1656 rated models, from 25 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande85.64Accuracy (%) (5-shot)98.7
Open LLM Leaderboard v1 - HellaSwag89.17Normalized accuracy (%) (10-shot)98.2
Open LLM Leaderboard v1 - TruthfulQA MC277.17MC2 (%) (0-shot)96.6
Open LLM Leaderboard v1 - ARC Challenge72.95Normalized accuracy (%) (25-shot)94.5
Open Chinese LLM - TruthfulQA MC62.51Accuracy (%)90.5
Open LLM Leaderboard v1 - GSM8K66.11Accuracy (%) (5-shot)81.2
Open Portuguese LLM - FaQuAD NLI77.33Macro F1 (%)79.4
Open Portuguese LLM - ASSIN2 RTE92.16Macro F1 (%)75.3
Open LLM Leaderboard v1 - MMLU64.44Accuracy (%) (5-shot)70.4
Open Chinese LLM - WinoGrande64.01Accuracy (%)63.2
Open Portuguese LLM - BLUEX55.08Accuracy (%)62.2
Open LLM Leaderboard - GPQA30.45Score61.3

Interactive version: theaggregate.ai/model?slug=mera-mix-4x7b · How It Works · Data refreshed daily, snapshot 2026-10-20.