SelfBench - supabase/supabase: leaderboard

Coding agents implement changes rebuilt from the merged pull requests of the open-source repository supabase/supabase: the pull request becomes the instruction and hidden tests written for it decide success. Each row is one model in one harness (Claude Code, Codex or pi) at one reasoning level. Task success rate, higher is better. Source: selfbench.dev.

Metric: Task success (%) on 36 tasks rebuilt from the repository's merged pull requests (hidden tests). Source: selfbench.dev. Saturation forecast: Around March 2027. 8 models tracked. Updated 13 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-6.1 SolHigh77.78#12
2Claude Opus 5.5High77.78#7
3Kimi K3High77.78#59
4Claude Sonnet 5.5High77.78#21
5DeepSeek V4.1 FlashHigh69.44#69
6GPT-6 LunaHigh66.67#105
7GLM-5.3 FlashHigh66.67#136
8GLM-5.3High66.67#73

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=selfbench-supabase-supabase · How It Works · Data refreshed daily, snapshot 2026-11-17.