SEAR - RoboLab - Vanilla: leaderboard
SEAR - RoboLab - Vanilla. Mean over three runs (two marked in paper); Vanilla code-library protocol. RoboLab full task population; its 58-task DeepSeek lineage result is not pooled.. Reported metric: Test success (%). Primary published table, with source configuration boundaries preserved.
Metric: Test success (%). Source: arxiv.org. Saturation forecast: Around March 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 61.9 | #12 |
| 2 | GPT-5.6 Sol | 46.9 | #18 |
| 3 | Kimi K3 | 30.1 | #30 |
| 4 | DeepSeek V4 Flash | 23.1 | #134 |
| 5 | Gemini 3.6 Flash | 18.3 | #50 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=sear-robolab-vanilla · How It Works · Data refreshed daily, snapshot 2026-10-16.