DeepSeek R1 Distill Llama 8B: benchmark results

DeepSeek's distilled reasoning model, transferring DeepSeek-R1's reasoning behavior onto a Llama 8B architecture, one of six dense models the team distilled from R1 using Llama and Qwen bases. Provider: DeepSeek. Released 2025-01-20. Access: Open.

Aggregate Rating 1380 ± 11, rank #1291 of 1656 rated models, from 357 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
JailNewsBench (Research Front) - Harmfulness Score2.4Mean harmfulness of the generated fake news (0 to 4): the av100
Open CoT - LogiQA13.26CoT Gain (%)99.2
Open CoT - LogiQA 218.26CoT Gain (%)98.5
Open CoT Leaderboard16.1Average CoT Gain (%)96.9
Open CoT - LSAT Reading Comprehension22.68CoT Gain (%)93.9
JailNewsBench (System Override) - Harmfulness Score2.5Mean harmfulness of the generated fake news (0 to 4): the av93.8
RFEval - Paper Review94.53Contrast-conditional reasoning faithfulness (%): after a cou90
Open CoT - LSAT Analytical Reasoning8.26CoT Gain (%)89.3
StakeBench - Commitment Detection72.1Accuracy (%) on G1: does a comment come from a user holding 85.7
Open CoT - LSAT Logical Reasoning18.04CoT Gain (%)84.7
JailNewsBench (Context Overload) - Harmfulness Score2.1Mean harmfulness of the generated fake news (0 to 4): the av81.2
FACTS Leaderboard40.68Combined Score (%)75.8

Interactive version: theaggregate.ai/model?slug=deepseek-r1-distill-llama-8b · How It Works · Data refreshed daily, snapshot 2026-10-20.