NOPO Study Baseline - CodeContests Pass512: leaderboard

The NOPO paper reports oracle pass@k for untouched, non-thinking Qwen3 baselines on coding, logic and mathematics tasks. The sample count k is part of each metric. The study’s weight-updated reinforcement-learning policies are separate artifacts and are not assigned to these original checkpoints. This board reports oracle pass@512 (%). Higher is better.

Metric: Oracle pass@512 (%). Source: arxiv.org. 1 model tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Qwen3-4BNon-thinking51.05

Interactive version: theaggregate.ai/benchmark?slug=nopo-study-baseline-codecontests-pass512 · How It Works · Data refreshed daily, snapshot 2026-11-16.