deepseek-llm-7B-base: benchmark results

DeepSeek LLM 7B base checkpoint. Provider: DeepSeek. Released 2023-11-29. Access: Open.

Aggregate Rating 1319 ± 22, rank #1443 of 1656 rated models, from 25 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Chinese LLM - HellaSwag61.91Accuracy (%)65.1
Open Chinese LLM - WinoGrande64.01Accuracy (%)63.2
Open Portuguese LLM - OAB Exams35.67Accuracy (%)33
Open Portuguese LLM - BLUEX38.39Accuracy (%)31.7
Open Portuguese LLM - ENEM41.78Accuracy (%)30.5
Open LLM Leaderboard - GPQA27.35Score28.5
TheoremQA15.7Score (%)27.3
Open Chinese LLM - ARC Challenge47.1Accuracy (%)26.2
Open LLM Leaderboard - MuSR37.38Score25.7
pfgen-bench - Completion Mode - Fluency0.42Fluency Score20.9
Open LLM Leaderboard - MMLU-Pro18.06Score19.6
Open LLM Leaderboard - BBH35.03Score19.2

Interactive version: theaggregate.ai/model?slug=deepseek-llm-7b-base · How It Works · Data refreshed daily, snapshot 2026-10-20.