CoderO1-DeepSeekR1-Coder-32B-Preview: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1493 ± 35, rank #2468 of 10916 rated models, from 50 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Japanese LLM - Wiki NER SET F113.27Score (%)90.1
Open Japanese LLM - Janli Exact Match84.72Score (%)85.8
Open Japanese LLM - Wiki PAS SET F18.62Score (%)83.4
Open Japanese LLM - CG58.23Score (%)83.1
Open Japanese LLM - Mbpp Pylint Check70.68Score (%)63.6
Open Japanese LLM - Wiki Coreference SET F13.58Score (%)58.1
Open Japanese LLM - MR88.4Score (%)55.5
Open Japanese LLM - Wiki Dependency SET F134.9Score (%)55.3
Open Japanese LLM Leaderboard59.5Average Score (%)54.1
Open Japanese LLM - MMLU EN Exact Match72.37Score (%)52.2
Open Japanese LLM - HE67.71Score (%)51.9
Open Japanese LLM - Jamp Exact Match62.36Score (%)50.8

Interactive version: theaggregate.ai/model?slug=codero1-deepseekr1-coder-32b-preview · How It Works · Data refreshed daily, snapshot 2026-11-08.