PointQ-Bench - Usability Grading: leaderboard
Metric: Macro-F1 (%) of the three-level usability decision, zero-shot over 3,083 point clouds (authentic scans, simulated distortions, AI-generated assets), temperature 0; 2D models see six rendered views, native 3D models 8,192 sampled points; free-form answers mapped to the label space by an LLM parser; higher is better. Source: arxiv.org. Saturation forecast: Around March 2027. 14 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5 (Low) | 50.13 |
| 2 | Qwen 3.5 27B (Non-reasoning) | 46.05 |
| 3 | GPT-5 Mini (Low) | 40.91 |
| 4 | Mistral Small 3.2 | 38.56 |
| 5 | Claude Haiku 4.5 | 34.4 |
| 6 | Qwen 3.5 9B (Non-reasoning) | 24.68 |
| 7 | Gemma 3 12B | 18.5 |
Interactive version: theaggregate.ai/benchmark?slug=pointq-bench-usability-grading · How It Works · Data refreshed daily, snapshot 2026-10-07.