Cypher-Mini-1.8B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1209 ± 37, rank #9566 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K14.48Accuracy (%) (5-shot)36.4
Open LLM Leaderboard v1 - HellaSwag67.45Normalized accuracy (%) (10-shot)18.4
Open LLM Leaderboard v1 - WinoGrande65.19Accuracy (%) (5-shot)18.4
Open LLM Leaderboard v1 - MMLU31.14Accuracy (%) (5-shot)17
Open LLM Leaderboard v1 - ARC Challenge39.59Normalized accuracy (%) (25-shot)15.9
Open LLM Leaderboard v1 - TruthfulQA MC240.44MC2 (%) (0-shot)14.2

Interactive version: theaggregate.ai/model?slug=cypher-mini-1-8b · How It Works · Data refreshed daily, snapshot 2026-11-08.