deepseek-llm-7B-chat [float16] [rev: afbda8b347ec]: benchmark results

Provider: DeepSeek. Access: Open.

Aggregate Rating 1345 ± 34, rank #7838 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K45.94Accuracy (%) (5-shot)59.7
Open LLM Leaderboard v1 - WinoGrande74.9Accuracy (%) (5-shot)39.3
Open LLM Leaderboard v1 - TruthfulQA MC247.92MC2 (%) (0-shot)39.2
Open LLM Leaderboard v1 - HellaSwag79.38Normalized accuracy (%) (10-shot)37.7
Open LLM Leaderboard v1 - ARC Challenge55.72Normalized accuracy (%) (25-shot)34
Open LLM Leaderboard v1 - MMLU51.77Accuracy (%) (5-shot)31

Interactive version: theaggregate.ai/model?slug=deepseek-llm-7b-chat-float16-rev-afbda8b347ec · How It Works · Data refreshed daily, snapshot 2026-11-08.