Galileo Tool Tasks - BFCL v3 Multi-Turn Long Context: leaderboard

Tool-use evaluation from Galileo covering BFCL v3 long-context multi-turn tasks where relevant function arguments are spread across conversation history.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 19 models tracked.

Top models

#ModelScoreOverall rank
1Claude 3.7 Sonnet (20250219)94#201
2Gemini 1.5 Pro91#445
3Gemini 2.0 Flash (001)91#360
4O1 (2024-12-17)88#149
5Gemini 1.5 Flash87#618
6O3 Mini (2025-01-31)85#240
7GPT-4o Mini83#599
8GPT-4o (2024-11-20)83#381
9Mistral Small 380#627
10Llama 3.3 70B Instruct79#534
11Qwen 2.5 72B Instruct79#454
12Ministral-8B-Instruct-241078#1094
13Mistral Large 2 (Nov) Instruct (2411)77#465
14Llama 3.1 8B Instruct73#1035
15Claude 3.5 Haiku (20241022)73#588

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=galileo-tool-tasks-bfcl-v3-multi-turn-long-context · How It Works · Data refreshed daily, snapshot 2026-10-20.