Elliot Caption Quality - Errors per tile: leaderboard
Elliot Caption Quality - Errors per tile. 100 stratified tiles;blind ClaudeOpus5.5 judge sees image,fact sheet,four randomized captions. Mean over tiles; source Table5. Input conditions retained on exact run labels. Metric: Errors per tile. Primary published table; source configurations remain distinct.
Metric: Errors per tile. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6.1 Sol (Elliot Run: Fact sheet) | 0.4 | |
| 2 | GPT-6.1 Sol (Elliot Run: Fact sheet and image) | 0.41 | |
| 3 | GPT-6 Luna (Elliot Run: Fact sheet) | 0.72 |
Interactive version: theaggregate.ai/benchmark?slug=elliot-caption-quality-errors-per-tile · How It Works · Data refreshed daily, snapshot 2026-10-16.