Artigenz-Coder-DS-6.7B: benchmark results

Provider: Other.

Aggregate Rating 1452 ± 42, rank #3683 of 10916 rated models, from 11 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BigCode Models Leaderboard70.9HumanEval Python Pass@1 (%)83.1
EvalPlus (HumanEval+ & MBPP+)71.1Pass@1 avg (%)83.1
EffiBench - NMU1.91Normalized Memory Usage58.5
BigCodeBench38Pass@1 (%)48.8
MBPP+69.6MBPP+ pass@1 (imported)37.5
EvalPlus71.1EvalPlus Avg. (imported)25
EffiBench - NET3.22Normalized Execution Time12.2
HumanEval+72.6HumanEval+ pass@1 (imported)8.7
ArchBench Serverless Component Generation67Codebase Test Pass Rate (%, no human intervention)0
ArchBench Serverless Component Generation - CodeBLEU26CodeBLEU (0-100)0
ArchBench Serverless Component Generation - Function Tests0Function Test Pass Rate (%, no human intervention)0

Interactive version: theaggregate.ai/model?slug=artigenz-coder-ds-6-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.