OpenCodeInterpreter-DS-33B: benchmark results
Provider: Other.
Aggregate Rating 1460 ± 43, rank #3317 of 10916 rated models, from 13 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| BigCode Models Leaderboard | 75.2 | HumanEval Python Pass@1 (%) | 88.1 |
| EvalPlus (HumanEval+ & MBPP+) | 71.2 | Pass@1 avg (%) | 83.9 |
| CodeEditorBench Plus - Code Requirement Switch (Three-shot) | 22.9 | pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus | 83.3 |
| CodeEditorBench Plus - Code Requirement Switch (Zero-shot) | 14.1 | pass@1 (%, greedy decoding, zero-shot, CodeEditorBench_Plus) | 77.8 |
| CodeEditorBench Plus - Code Translate (Three-shot) | 37.1 | pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus | 72.2 |
| CodeEditorBench Plus - Code Translate (Zero-shot) | 36.8 | pass@1 (%, greedy decoding, zero-shot, CodeEditorBench_Plus) | 66.7 |
| CodeEditorBench Plus - Code Debug (Zero-shot) | 23.6 | pass@1 (%, greedy decoding, zero-shot, CodeEditorBench_Plus) | 61.1 |
| EffiBench - NMU | 1.91 | Normalized Memory Usage | 58.5 |
| CodeEditorBench Plus - Code Debug (Three-shot) | 23 | pass@1 (%, greedy decoding, three-shot, CodeEditorBench_Plus | 50 |
| EvalPlus | 71.15 | EvalPlus Avg. (imported) | 29.2 |
| EffiBench - NET | 3.15 | Normalized Execution Time | 24.4 |
| HumanEval+ | 73.8 | HumanEval+ pass@1 (imported) | 19.6 |
Interactive version: theaggregate.ai/model?slug=opencodeinterpreter-ds-33b · How It Works · Data refreshed daily, snapshot 2026-11-08.