Plan2Map - Any Overlap: leaderboard

Metric: Share of cases (%) whose predicted boundary overlaps the reference at all (IoU above 0), direct VLM-to-GeoJSON prediction from the planning document with no tool access, provider default temperature 1, on the paper 40-case stratified subset of the 208 UK planning records; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 4 models tracked.

Top models

#ModelScore
1GPT-5.5 Pro50
2Gemini 3.1 Pro (Preview)42.5
3Gemini 3 Flash30
4Claude Opus 4.722.5

Interactive version: theaggregate.ai/benchmark?slug=plan2map-any-overlap · How It Works · Data refreshed daily, snapshot 2026-09-29.