OpenCodeInterpreter-DS-6.7B: benchmark results

Provider: Other.

Aggregate Rating 1440 ± 43, rank #4206 of 10916 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
CIBER (OpenCodeInterpreter)49.3Attack success rate (%) of memory-poisoning, indirect-inject100
CIBER (OpenCodeInterpreter) - Direct Prompt Injection50.4Attack success rate (%) of direct prompt-injection attacks a100
CIBER (OpenCodeInterpreter) - Prompt-Based Backdoor0Attack success rate (%) of prompt-based backdoor attacks aga100
BigCode Models Leaderboard73.2HumanEval Python Pass@1 (%)86.4
EvalPlus (HumanEval+ & MBPP+)69.2Pass@1 avg (%)79.8
CodeEditorBench Plus - Code Translate (Three-shot)37.2pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus77.8
CIBER (OpenCodeInterpreter) - Memory Poisoning67.5Attack success rate (%) of memory-poisoning attacks against 66.7
CodeEditorBench Plus - Code Requirement Switch (Three-shot)16.5pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus66.7
CodeEditorBench Plus - Code Requirement Switch (Zero-shot)12.6pass@1 (%, greedy decoding, zero-shot, CodeEditorBench_Plus)66.7
McEval46AVG (%)64.3
CodeEditorBench Plus - Code Translate (Zero-shot)35.7pass@1 (%, greedy decoding, zero-shot, CodeEditorBench_Plus)61.1
EffiBench - NMU1.91Normalized Memory Usage58.5

Interactive version: theaggregate.ai/model?slug=opencodeinterpreter-ds-6-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.