PointQ-Bench - Usability Grading: leaderboard
Three-level usability grading of point clouds on 3,083 point clouds from real scans, simulated distortions and AI-generated assets (PointQ-Bench, 2026), with 2D models seeing six rendered views and 3D models sampled points. Macro-F1 in percent; higher is better.
Metric: Macro-F1 (%) of the three-level usability decision, zero-shot over 3,083 point clouds (authentic scans, simulated distortions, AI-generated assets), temperature 0; 2D models see six rendered views, native 3D models 8,192 sampled points; free-form answers mapped to the label space by an LLM parser; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 13 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5 | Low | 50.13 | #178 |
| 2 | Qwen 3.5 27B | Non-reasoning | 46.05 | #375 |
| 3 | GPT-5 Mini | Low | 40.91 | #364 |
| 4 | Mistral Small 3.2 | 38.56 | #1641 | |
| 5 | InternVL3.5-8B | 38.28 | #1604 | |
| 6 | InternVL3.5-14B | 35.83 | #1504 | |
| 7 | PointLLM-13B | 35.64 | ||
| 8 | Claude Haiku 4.5 | 34.4 | #583 | |
| 9 | PointLLM-7B | 34.08 | ||
| 10 | ShapeLLM-13B | 25.01 | ||
| 11 | Qwen 3.5 9B | Non-reasoning | 24.68 | #828 |
| 12 | ShapeLLM-7B | 24.18 | ||
| 13 | Gemma 3 12B | 18.5 | #2059 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=pointq-bench-usability-grading · How It Works · Data refreshed daily, snapshot 2026-11-21.