BIM-Edit - Topology: leaderboard

Metric: Topology score (0-100): weighted F1 of edited nodes (0.3) and edited relations (0.7) in the IFC difference graph against the reference edit, on 324 natural-language create, update and delete tasks on 11 real and 36 synthetic IFC building models (direct, spatial and topological instructions), the model edits the IFC file as an agent that runs Python through a single IfcOpenShell execution tool with a 20-call budget, temperature 0 where settable; mean over tasks; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 7 models tracked.

Top models

#ModelScore
1Qwen 3.6 Plus47.77
2Claude Sonnet 4.646.19
3DeepSeek V3.243.86
4GPT-5.4 Pro (xHigh)42.97
5Gemini 3 Flash (Preview)37.77
6Gemma 4 31B (IT)37.75
7GPT-5.4 Mini35.38

Interactive version: theaggregate.ai/benchmark?slug=bim-edit-topology · How It Works · Data refreshed daily, snapshot 2026-09-29.