Metis-0.4 [float16] [rev: c2b149c7df28]: benchmark results

Provider: Mihaiii. Access: Open.

Aggregate Rating 1401 ± 33, rank #6071 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC259.2MC2 (%) (0-shot)73.4
Open LLM Leaderboard v1 - HellaSwag83.91Normalized accuracy (%) (10-shot)62.4
Open LLM Leaderboard v1 - ARC Challenge62.29Normalized accuracy (%) (25-shot)57.1
Open LLM Leaderboard v1 - MMLU62.7Accuracy (%) (5-shot)56.4
Open LLM Leaderboard v1 - WinoGrande77.35Accuracy (%) (5-shot)55.2
Open LLM Leaderboard v1 - GSM8K22.21Accuracy (%) (5-shot)42.3

Interactive version: theaggregate.ai/model?slug=metis-0-4-float16-rev-c2b149c7df28 · How It Works · Data refreshed daily, snapshot 2026-11-08.