Yi-Coder-9B-Chat: benchmark results

Provider: 01.AI. Released 2024-08-21. Access: Open.

Unified ELO 1412 ± 1, rank #1093 of 1392 rated models, from 54 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MERA Code - YABLoCo13.46pass@1 (%)93.8
MERA - ruHumanEval41.4pass@1 (%)81.7
MERA - ruCodeEval38.35pass@1 (%)78.9
MERA - BPS98.5Accuracy (%)76.4
MERA - RWSD61.54Accuracy (%)73.7
MERA - LCS16.6Accuracy (%)68.7
MERA Code - JavaTestGen22.91pass@1 (%)66.9
MERA Code - ruCodeEval35pass@1 (%)60
Open LLM Leaderboard - IFEval48.17Score56.2
BigCodeBench38.1Pass@1 (%)49.6
CodeElo296Elo Rating44.1
MERA Code - RealCodeJava25.5pass@1 (%)43.8

Interactive version: theaggregate.ai/model?slug=yi-coder-9b-chat · How It Works · Data refreshed daily, snapshot 2026-09-05.