HARE - Spider 2.0 Origin - BIRD-History: leaderboard
HARErequests partitionedbyhistoricalsourcebenchmark, NOT originalSpider/BIRDtestset. MEMusesOSL, othermethodsUSL; nativeTable5, all6modelcolumns. Modelandmethodretainedseparately. Metric: Execution accuracy (%). Source: https://arxiv.org/html/2611.18338v1
Metric: Execution accuracy (%). Source: arxiv.org. Saturation forecast: Around 2029. 6 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 4 Argon | 37.3 | #14 |
| 2 | GLM-5.3 Flash | 35.8 | #136 |
| 3 | Qwen 3.8 27B | 29.9 | #219 |
| 4 | GPT-6 Luna | 28.7 | #105 |
| 5 | Granite 4.2 8B | 22.4 | #1561 |
| 6 | Qwen 3.5 9B | 16.8 | #822 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=hare-spider-2-0-origin-bird-history · How It Works · Data refreshed daily, snapshot 2026-11-17.