DeepSeek V2: benchmark results

DeepSeek's 236B open MoE (21B active) with Multi-head Latent Attention and a 128K context. Provider: DeepSeek. Released 2024-05-06. Access: Open.

Aggregate Rating 1569 ± 33, rank #549 of 1656 rated models, from 16 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ARC Challenge (AI2)92.2Accuracy (%)96.1
SuperCLUE General (June 2024) - Liberal Arts76Score93.8
WinoGrande86.3Accuracy (%)92.5
HellaSwag87.1Accuracy (%)92.1
Big-Bench Hard78.8Average (%)87.5
SuperCLUE General (June 2024) - Overall76Score87.5
PIQA83.9Accuracy (%)86.7
SuperCLUE General (June 2024) - Hard78Score85.9
MMLU78.4Accuracy (%)77.6
SuperCLUE General (June 2024) - Science74Score75
SuperCLUE-Code3 - Overall80.3Score70.6
MixEval51.7Score68.6

Interactive version: theaggregate.ai/model?slug=deepseek-v2 · How It Works · Data refreshed daily, snapshot 2026-10-20.