GPSBench (Applied) - Boundary Analysis: leaderboard

Metric: Score (%) on the boundary analysis (group four to six named cities by country or continent) task of GPSBench's Applied Track (geographic reasoning that combines coordinates or place names with world knowledge); 1,020 test samples; zero-shot from the model's own knowledge, no tools, no chain-of-thought or few-shot prompting, temperature 0; choice tasks score accuracy and numerical tasks one minus the mean absolute percentage error; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 14 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 30B A3B 2507 Instruct99.7#464
2GPT-5 Nano (Low)98.5#415 (GPT-5 Nano)
3Qwen 3 14B (Non-reasoning)98.2#524 (Qwen 3 14B)
4GPT-5.1 (Low)98.1#131 (GPT-5.1)
5Mistral Small 397.8#616
6Claude Haiku 4.597.6#271
7Qwen 3 8B (Non-reasoning)96.5#667 (Qwen 3 8B)
8Mistral Large 377.3#388
9Qwen 3 235B A22B 2507 Instruct67.4#291
10GPT-5 Mini (Low)67.4#176 (GPT-5 Mini)
11GPT-4.1 Mini56#346
12Gemini 2.5 Flash (Non-reasoning)47.7#237 (Gemini 2.5 Flash)
13GPT-4.145.2#240
14Gemini 2.5 Pro21.5#145

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=gpsbench-applied-boundary-analysis · How It Works · Data refreshed daily, snapshot 2026-10-11.