PointQ-Bench - Defect Diagnosis: leaderboard
Multi-label diagnosis of which of eight quality defects a point cloud has, on 3,083 point clouds from real scans, simulated distortions and AI-generated assets (PointQ-Bench, 2026), with 2D models seeing six rendered views and 3D models sampled points. Sample-level F1 in percent; higher is better.
Metric: Sample-level F1 (%) of the multi-label defect diagnosis (which of eight issue types are present; no defect is an empty set), zero-shot over 3,083 point clouds (authentic scans, simulated distortions, AI-generated assets), temperature 0; 2D models see six rendered views, native 3D models 8,192 sampled points; free-form answers mapped to the label space by an LLM parser; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5 | Low | 42.32 | #178 |
| 2 | Qwen 3.5 9B | Non-reasoning | 39.95 | #828 |
| 3 | GPT-5 Mini | Low | 39.6 | #364 |
| 4 | Gemma 3 12B | 37.3 | #2059 | |
| 5 | Claude Haiku 4.5 | 36.88 | #583 | |
| 6 | InternVL3.5-8B | 34.83 | #1604 | |
| 7 | Mistral Small 3.2 | 34.3 | #1641 | |
| 8 | Qwen 3.5 27B | Non-reasoning | 33.87 | #375 |
| 9 | ShapeLLM-13B | 32.42 | ||
| 10 | InternVL3.5-14B | 30.24 | #1504 | |
| 11 | PointLLM-7B | 28.08 | ||
| 12 | ShapeLLM-7B | 26.22 | ||
| 13 | PointLLM-13B | 14.95 | ||
| 14 | MiniGPT-3D | 10.96 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=pointq-bench-defect-diagnosis · How It Works · Data refreshed daily, snapshot 2026-11-21.