DeepSeek V4 Pro: benchmark results

DeepSeek's open 1600B V4 Pro model for high-end reasoning and general tasks. Provider: DeepSeek. Released 2026-04-24. Access: Open.

Aggregate Rating 1761 ± 2, rank #102 of 1656 rated models, from 2323 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AdvancedMathBench - VerifierBench65.1Meta-verification balanced F1 (%): a validity verdict counts100
AfriEconQA54.5Token F1 (%; 862 held-out test questions, answered from the 100
AfriEconQA (Closed-Book)26.7Token F1 (%; 862 held-out test questions, question only with100
AfriEconQA - Comparison50.8Token F1 (%; the comparison questions (across periods, count100
AfriEconQA - List10.1Set F1 (%; the list questions (every factor, risk or interve100
AfriEconQA - Multiple Choice88.4F1 (%; the four-option multiple-choice questions (answered w100
AfriEconQA - Synthesis43.3Token F1 (%; the synthesis questions (connected policy claim100
AgentS4D - Task Completion (Codex CLI)96.65Task completion rate (%): runs whose case-specific completio100
AgentS4D - Task Completion (Hermes Agent)98.48Task completion rate (%): runs whose case-specific completio100
AgentS4D - Task Completion (OpenClaw)97.26Task completion rate (%): runs whose case-specific completio100
AppWorld-UL (Function Calling) - Infeasible Tasks33.3Interactive task goal completion (%; share of 102 tasks made100
AuthMem-Bench (Unauthorized Action Rate)38.6Attack success rate (%; share of 350 non-authorizing cases i100

Interactive version: theaggregate.ai/model?slug=deepseek-v4-pro · How It Works · Data refreshed daily, snapshot 2026-10-20.