Umbra-MoE-4x10.7: benchmark results

Provider: Other.

Aggregate Rating 1459 ± 36, rank #3375 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - HellaSwag87.81Normalized accuracy (%) (10-shot)88
Open LLM Leaderboard v1 - WinoGrande83.27Accuracy (%) (5-shot)87.9
Open LLM Leaderboard v1 - MMLU66.42Accuracy (%) (5-shot)87.2
Open LLM Leaderboard v1 - TruthfulQA MC267.82MC2 (%) (0-shot)86.6
Open LLM Leaderboard v1 - ARC Challenge70.31Normalized accuracy (%) (25-shot)85.6
Open LLM Leaderboard v1 - GSM8K64.75Accuracy (%) (5-shot)78.9

Interactive version: theaggregate.ai/model?slug=umbra-moe-4x10-7 · How It Works · Data refreshed daily, snapshot 2026-11-08.