GPSBench (Pure GPS) - Bearing Computation: leaderboard

Metric: Score (%) on the bearing computation (initial bearing between two coordinates) task of GPSBench's Pure GPS Track (geometric computation on coordinates); 1,020 test samples; zero-shot from the model's own knowledge, no tools, no chain-of-thought or few-shot prompting, temperature 0; choice tasks score accuracy and numerical tasks one minus the mean absolute percentage error; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.1 (Low)99.9#131 (GPT-5.1)
2GPT-5 Mini (Low)99.8#176 (GPT-5 Mini)
3Gemini 2.5 Pro99.2#145
4GPT-4.197.5#240
5GPT-4.1 Mini90.9#346
6Qwen 3 30B A3B 2507 Instruct90.5#464
7Claude Haiku 4.584.5#271
8Qwen 3 235B A22B 2507 Instruct83#291
9Gemini 2.5 Flash (Non-reasoning)72.7#237 (Gemini 2.5 Flash)
10GPT-5 Nano (Low)67.3#415 (GPT-5 Nano)
11Mistral Large 356.7#388
12Qwen 3 14B (Non-reasoning)52.3#524 (Qwen 3 14B)
13Mistral Small 347.1#616
14Qwen 3 8B (Non-reasoning)45.1#667 (Qwen 3 8B)

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=gpsbench-pure-gps-bearing-computation · How It Works · Data refreshed daily, snapshot 2026-10-11.