PilotBench - Regression Score: leaderboard

Metric: Regression score (0-100): 0.6 x piecewise-linear MAE score plus 0.4 x RMSE score of the predicted flight state, on PilotBench (one-step trajectory and attitude prediction from 34-channel telemetry of 708 general-aviation trajectories in nine flight phases, fixed output schema, temperature 0); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 19 models tracked.

Top models

#ModelScore
1QwQ-32B85.53
2Qwen 3 32B85.43
3O3 Mini84.24
4Doubao-1.5-Pro-32k83.53
5Qwen 2.5 72B Instruct83.2
6DeepSeek V383.19
7GPT-4o Mini82.99
8Qwen 2.5 32B Instruct79.01
9Qwen 2.5 14B Instruct76.31
10Qwen 2.5 VL 72B Instruct65.66
11Qwen 2.5 7B Instruct54.98
12DeepSeek R1 Distill Llama 70B52.77
13glm-4-9B50.75
14DeepSeek R1 Distill Qwen 32B38.24
15Qwen 3 14B19.84

Interactive version: theaggregate.ai/benchmark?slug=pilotbench-regression-score · How It Works · Data refreshed daily, snapshot 2026-10-07.