Plan2Map: leaderboard

Metric: Mean IoU (%) between the predicted and the held-out reference boundary polygons, times 100, direct VLM-to-GeoJSON prediction from the planning document with no tool access, provider default temperature 1, on the paper 40-case stratified subset of the 208 UK planning records; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 4 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)11.2
2GPT-5.5 Pro10.6
3Gemini 3 Flash5.3
4Claude Opus 4.74.4

Interactive version: theaggregate.ai/benchmark?slug=plan2map · How It Works · Data refreshed daily, snapshot 2026-09-29.