OWE-Bench - SmolLM3 Draft Head: leaderboard
OWE-Bench - SmolLM3 Draft Head — Expert-built long-horizon science, software, ML and engineering tasks with task-specific hardware and4–18hour budgets; native baseline/ceiling normalized held-out reward,mean of8attempts and equal task means. Web frozen October1,2026;deterministic sealed verifier. Native model/effort and every attempt retained. Score fraction0–1;higher is better.
Metric: Mean normalized held-out task score (fraction, 0–1). Source: openworldengineer.mercor.com. Saturation forecast: Around December 2027. 14 models tracked. Updated 15 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 4 Argon | High | 0.3919 | #12 |
| 2 | Claude Fable 5.2 | Max | 0.3902 | #1 |
| 3 | Claude Sonnet 5.5 | Max | 0.3854 | #19 |
| 4 | GPT-6.1 Sol | Max | 0.3801 | #10 |
| 5 | GPT-6 Astra | Max | 0.3691 | #6 |
| 6 | Claude Fable 5.1 | Max | 0.3641 | #15 |
| 7 | Gemini 4 Carbon | High | 0.353 | #2 |
| 8 | Claude Opus 5.5 | Max | 0.3486 | #5 |
| 9 | DeepSeek V4.1 Flash | Max | 0.1915 | #62 |
| 10 | GLM-5.3 | Max | 0.1354 | #68 |
| 11 | Muse Wonder | Max | 0.1089 | #28 |
| 12 | Grok 4.7 | xHigh | 0.06856 | #47 |
| 13 | Beam 1.0 | Max | 0.03145 | #206 |
| 14 | Inkling | Max | 0.002375 | #281 |
Interactive version: theaggregate.ai/benchmark?slug=owe-bench-smollm3-draft-head · How It Works · Data refreshed daily, snapshot 2026-11-16.