DeciLM-7B: benchmark results

Provider: Deci AI. Released 2023-12-10. Access: Open.

Unified ELO 1409 ± 1, rank #1101 of 1392 rated models, from 13 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open CoT - LSAT Analytical Reasoning6.52CoT Gain (%)81.3
Open LLM Leaderboard - MuSR13.05Score71.7
Open LLM Leaderboard - GPQA6.04Score50.7
Open CoT - LSAT Reading Comprehension8.18CoT Gain (%)34.4
Open LLM Leaderboard - BBH21.25Score31.7
CyberMetric50.22Accuracy (%)29.2
Open CoT - LSAT Logical Reasoning6.27CoT Gain (%)28.6
Open LLM Leaderboard - MMLU-Pro18.8Score28.5
Open CoT Leaderboard4.48Average CoT Gain (%)27.1
Open LLM Leaderboard - IFEval28.13Score25.3
Open CoT - LogiQA1.6CoT Gain (%)19.5
Open LLM Leaderboard - MATH Level 52.87Score18.2

Interactive version: theaggregate.ai/model?slug=decilm-7b · How It Works · Data refreshed daily, snapshot 2026-09-05.