NOPO Study Baseline - CodeContests Pass512: leaderboard
The NOPO paper reports oracle pass@k for untouched, non-thinking Qwen3 baselines on coding, logic and mathematics tasks. The sample count k is part of each metric. The study’s weight-updated reinforcement-learning policies are separate artifacts and are not assigned to these original checkpoints. This board reports oracle pass@512 (%). Higher is better.
Metric: Oracle pass@512 (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Qwen3-4B | Non-thinking | 51.05 |
Interactive version: theaggregate.ai/benchmark?slug=nopo-study-baseline-codecontests-pass512 · How It Works · Data refreshed daily, snapshot 2026-11-16.