MiniChat-1.5-3B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1284 ± 27, rank #8938 of 10916 rated models, from 14 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC250.71MC2 (%) (0-shot)49.3
Open LLM Leaderboard v1 - GSM8K24.18Accuracy (%) (5-shot)43.4
AlpacaEval 1.078.55Win Rate (%)35.6
AlpacaEval51.48Length-Controlled Win Rate (%)29.8
Open LLM Leaderboard v1 - MMLU46.67Accuracy (%) (5-shot)25.3
Open LLM Leaderboard v1 - ARC Challenge46.5Normalized accuracy (%) (25-shot)21.6
Open LLM Leaderboard v1 - HellaSwag68.28Normalized accuracy (%) (10-shot)19.2
Open LLM Leaderboard v1 - WinoGrande65.04Accuracy (%) (5-shot)18.2
AlpacaEval 2.07.7LC Win Rate (%)14.4
Open Portuguese LLM - FaQuAD NLI0Macro F1 (%)1
Open Portuguese LLM - ASSIN2 RTE0Macro F1 (%)0.9
Open Portuguese LLM - OAB Exams0Accuracy (%)0.9

Interactive version: theaggregate.ai/model?slug=minichat-1-5-3b · How It Works · Data refreshed daily, snapshot 2026-11-08.