DriveSpatial - Understanding RMSE: leaderboard
Metric: Root mean squared error of numeric answers (distances, counts and other spatial measurements) on the spatial-understanding tasks on the full benchmark (15,670 human-verified questions over 20 tasks from nuScenes, Waymo, TruckScenes, AV2 and ONCE); open-source generalist and driving or spatial specialist VLMs; lower is better. Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 3 12B (IT) | 14.65 |
| 2 | InternVL3-8B | 15.95 |
Interactive version: theaggregate.ai/benchmark?slug=drivespatial-understanding-rmse · How It Works · Data refreshed daily, snapshot 2026-10-07.