SidewalkBench - Long-Horizon (Real-World Scanned): leaderboard

The same long-route test on 5 sidewalk routes scanned from real streets (3D Gaussian splatting): failures (collisions, lane exits and freezes) per 100 m travelled, lower is better. The procedurally generated routes are the headline board.

Metric: Failures per 100 m (collisions, lane exits and freezes) on 5 long-horizon routes in real-world scanned scenes (lower is better). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 8 models tracked.

Top models

#ModelScoreOverall rank
1S2E0.92
2FlowPilot0.92
3MIMIC1.66
4MBRA5.15
5NoMaD5.89
6InternVLA-N1-DualVLN9.39
7CityWalker10.86
8ViNT24.11

Interactive version: theaggregate.ai/benchmark?slug=sidewalkbench-long-horizon-real-world-scanned · How It Works · Data refreshed daily, snapshot 2026-11-13.