BIM-Edit - Geometry: leaderboard
Metric: Geometry score (0-100): exponential decay of the median bidirectional Chamfer distance between surface point clouds of the edited and the reference elements, on 324 natural-language create, update and delete tasks on 11 real and 36 synthetic IFC building models (direct, spatial and topological instructions), the model edits the IFC file as an agent that runs Python through a single IfcOpenShell execution tool with a 20-call budget, temperature 0 where settable; mean over tasks; higher is better. Source: arxiv.org. Saturation forecast: Around May 2028. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash (Preview) | 68.87 |
| 2 | Qwen 3.6 Plus | 59.21 |
| 3 | Claude Sonnet 4.6 | 55.9 |
| 4 | DeepSeek V3.2 | 50.97 |
| 5 | GPT-5.4 Pro (xHigh) | 50.14 |
| 6 | GPT-5.4 Mini | 45.18 |
| 7 | Gemma 4 31B (IT) | 44.94 |
Interactive version: theaggregate.ai/benchmark?slug=bim-edit-geometry · How It Works · Data refreshed daily, snapshot 2026-09-29.