ToolBench - Open Weather: leaderboard

ToolBench subtask measuring API/tool-call success on weather information requests.

Metric: Task Score. Source: huggingface.co. Saturation forecast: Estimated already saturated. 44 models tracked.

Top models

#ModelScoreOverall rank
1text-davinci-00399#1146
2CodeLlama-13B-Instruct-hf98#1532
3CodeLlama-34B-hf96.39#1515
4CodeLlama-34B-Instruct-hf94.28#1381
5GPT-493#438
6CodeLlama-13B-Python-hf93#1623
7CodeLlama-34B-Python-hf91.11#1552
8starcoder91#1577
9GPT-3.5 Turbo90#865
10Llama 2 70B90#1201
11LLaMA-65B90#1303
12CodeLlama-7B-Instruct-hf90#1545
13CodeLlama-7B-hf86#1457
14Llama 2 13B85#1436
15CodeLlama-7B-Python-hf83#1608

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=toolbench-open-weather · How It Works · Data refreshed daily, snapshot 2026-10-20.