PuzzleMate - Piece-to-Location Matching with Natural Language Reference (Aria): leaderboard
Metric: Accuracy (%; correct as judged by human annotators for clarity and spatial accuracy; task: describing in natural language, within 35 tokens, which of several unlabeled missing slots a given piece belongs to; three 48-piece jigsaw puzzles photographed from an egocentric viewpoint, Project Aria glasses camera (low-resolution, noisy egocentric images)). Source: arxiv.org. Saturation forecast: Around 2028. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.2 | 52 |
| 2 | Gemini 2.5 Pro | 48 |
| 3 | Gemma 3 27B | 41 |
| 4 | Gemma 3 12B | 37 |
| 5 | Gemma 3 4B | 28 |
Interactive version: theaggregate.ai/benchmark?slug=puzzlemate-piece-to-location-matching-with-natural-language-reference-aria · How It Works · Data refreshed daily, snapshot 2026-09-26.