LIBERO-PeRM Zero-shot - User Profile SR: leaderboard
LIBERO-PeRM v1 Table2; zero-shot LIBERO-SinglePref robot-action policies on edited LIBERO layouts; No-Pref uses original task language. SA = mean(task-success indicator * discrete preference label 0,0.25,0.75,1), not conditional success-only adherence. Metric: Task success (%). Higher is better. Source: https://arxiv.org/html/2610.22372v1
Metric: Task success (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | pi0.5 | 19.12 | |
| 2 | pi0-fast | 17.65 | |
| 3 | GR00T-N1.6 | 9.8 | |
| 4 | OpenVLA-OFT | 3.92 | |
| 5 | SmolVLA | 0 | |
| 6 | UniVLA | 0 |
Interactive version: theaggregate.ai/benchmark?slug=libero-perm-zero-shot-user-profile-sr · How It Works · Data refreshed daily, snapshot 2026-10-17.