SIGNPOST-Bench - Text-Removed Localization: leaderboard

Metric: Weighted localization accuracy (%; exp(-0.005 x geodesic km), four-dataset macro average). Source: arxiv.org. 20 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)50.16
2Gemini 3 Flash49.23
3Doubao-Seed-2.0-Pro-26021548.99
4GPT-545.67
5Gemini 2.5 Pro45.56
6Kimi K2.545.31
7Gemini 2.5 Flash43.23
8Claude Sonnet 4.642.42
9Claude Opus 4.640.85
10GPT-4o37.8
11Qwen 3 VL 235B A22B Instruct34.52
12Qwen 3 VL 30B A3B Instruct34.22
13GPT-5.432.02
14GPT-4o Mini28.42
15Grok 427.1

Interactive version: theaggregate.ai/benchmark?slug=signpost-bench-text-removed-localization · How It Works · Data refreshed daily, snapshot 2026-09-19.