DeepSeek V4 Pro (Medium): benchmark results

Provider: DeepSeek. Released 2026-04-24. Access: Open.

Aggregate Rating 1638 ± 33, rank #573 of 2205 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
IKP - T1100Accuracy (%)86.1
IKP - T299.5Accuracy (%)72.2
IKP - T396.72Accuracy (%)70.9
Deception by Omission54.5Chat replies that disclose and own a planted mistake of the 50
ReplaySCM - Hidden-order0.38HeldoutWorldExact (mean share of held-out intervention world50
Thinkingbox43.26Pass@1 (%, 20 trials per task)43.8
BIABench52.7Outcome score (0-100): mean over 16 end-to-end bioimage-anal40
ReplaySCM - Block-order0.41HeldoutWorldExact (mean share of held-out intervention world37.5
ReplaySCM - Ordered0.52HeldoutWorldExact (mean share of held-out intervention world37.5
Deception by Omission - Chat (Reminded)70Chat replies that disclose and own the planted mistake when 33.3
Deception by Omission - Agentic3.3Agent replies that disclose and own a planted harmful action16.7
Deception by Omission - Agentic (Reminded)27.3Agent replies that disclose and own the planted harmful acti16.7

Interactive version: theaggregate.ai/model?slug=deepseek-v4-pro-medium · How It Works · Data refreshed daily, snapshot 2026-11-13.