TransitLM - Connectivity: leaderboard
Metric: Connectivity (%): share of the 1,000 requests whose predicted station sequence has every consecutive pair adjacent on a shared line or linked by a valid transfer, TransitLM Optimal Route Generation, 1,000 test requests across Beijing, Shanghai, Shenzhen and Chengdu given origin and destination names with GPS coordinates and no map or routing engine; general LLMs answer in a lenient format (boarding and alighting station per leg); higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 75.5 |
| 2 | DeepSeek V4 Pro | 64.9 |
| 3 | Seed 2.0 Pro | 61.6 |
| 4 | GPT-5.4 Pro (xHigh) | 60.5 |
| 5 | Claude Opus 4.6 | 48.1 |
| 6 | Qwen 3.6 Plus | 45 |
Interactive version: theaggregate.ai/benchmark?slug=transitlm-connectivity · How It Works · Data refreshed daily, snapshot 2026-10-07.