SEAR - robosuite - Vanilla: leaderboard
SEAR - robosuite - Vanilla. Mean over three runs (two marked in paper); Vanilla code-library protocol. RoboLab full task population; its 58-task DeepSeek lineage result is not pooled.. Reported metric: Test success (%). Primary published table, with source configuration boundaries preserved.
Metric: Test success (%). Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 93.8 | #12 |
| 2 | GPT-5.6 Sol | 89 | #18 |
| 3 | Kimi K3 | 76.2 | #30 |
| 4 | Gemini 3.6 Flash | 70.5 | #50 |
| 5 | DeepSeek V4 Flash | 70 | #134 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=sear-robosuite-vanilla · How It Works · Data refreshed daily, snapshot 2026-10-16.