deepseek-llm-7B-chat [bfloat16] [rev: afbda8b347ec]: benchmark results

Provider: DeepSeek. Access: Open.

Aggregate Rating 1345 ± 34, rank #7834 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K46.55Accuracy (%) (5-shot)60.2
Open LLM Leaderboard v1 - TruthfulQA MC247.98MC2 (%) (0-shot)39.4
Open LLM Leaderboard v1 - WinoGrande74.82Accuracy (%) (5-shot)38.9
Open LLM Leaderboard v1 - HellaSwag79.38Normalized accuracy (%) (10-shot)37.7
Open LLM Leaderboard v1 - ARC Challenge55.8Normalized accuracy (%) (25-shot)34.2
Open LLM Leaderboard v1 - MMLU51.75Accuracy (%) (5-shot)31

Interactive version: theaggregate.ai/model?slug=deepseek-llm-7b-chat-bfloat16-rev-afbda8b347ec · How It Works · Data refreshed daily, snapshot 2026-11-08.