DeepSeek V3 Chat: benchmark results

Chat checkpoint whose post-training distills reasoning from an R1-series teacher while controlling response length. Uses compressed attention state to reduce inference memory. Provider: DeepSeek. Released 2024-12-26. Access: Open.

Aggregate Rating 1598 ± 10, rank #447 of 1656 rated models, from 169 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
DuckDB-NSQL80Execution Accuracy (%)100
Ru Arena Hard96.3Win Rate (%)100
VNTL Leaderboard74.24Accuracy (%)95.3
AGC-Bench - pun_eval1.22Dataset z-score95.1
AGC-Bench - story_generation_rocstories1.32Dataset z-score92.7
SpeechMap Compliance90% Requests Completed91.9
The Wrong Kind of Right5.2Misfired Alignment Rate, average over 8 categories (%) (self91.7
AGC-Bench - conceptual_design1.03Dataset z-score89
AGC-Bench - fann_or_flop0.92Dataset z-score85.4
AGC-Bench - unfun_corpus0.38Dataset z-score84.6
AGC-Bench - grapheval_ai_researcher0.7Dataset z-score82.7
AGC-Bench - ocw1.1Dataset z-score80.5

Interactive version: theaggregate.ai/model?slug=deepseek-v3-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.