DeepSeek R1 Distill Qwen 1.5B: benchmark results

DeepSeek's distilled reasoning model, transferring DeepSeek-R1's reasoning behavior onto a Qwen 1.5B architecture, one of six dense models the team distilled from R1 using Llama and Qwen bases. Provider: DeepSeek. Released 2025-01-20. Access: Open.

Aggregate Rating 1241 ± 11, rank #1551 of 1656 rated models, from 334 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LegalCiteBench - Case Matching53.42Cat4-1 judge score (0-100) for matching an anonymized legal 90
LegalCiteBench - Case Verification90.81Cat4-2 judge score (0-100) for verifying whether a cited cas90
LegalCiteBench - Citation Error Detection58.11Cat3 judge score (0-100) for detecting citation errors in le90
LegalCiteBench - Misleading Answer Rate94.62Misleading Answer Rate (%): share of low-scoring responses (90
LegalCiteBench - Citation Completion4.54Cat2 citation-level F1 (0-100) of the remaining source-opini85
LA Leaderboard - WNLI Basque56.34Accuracy (%)77.9
LA Leaderboard - QNLI Basque53.78Accuracy (%)75.7
LA Leaderboard - EusReading Basque30.4Accuracy (%)70.6
Open LLM Leaderboard - MATH Level 516.92Score65.3
LA Leaderboard - WiC Basque50Accuracy (%)64.7
Token Rewards Evaluation - GaoKao2023en73.1Pass@1 (%)64.3
Open CoT - LSAT Analytical Reasoning4.78CoT Gain (%)63

Interactive version: theaggregate.ai/model?slug=deepseek-r1-distill-qwen-1-5b · How It Works · Data refreshed daily, snapshot 2026-10-20.