SEAL - Agentic Tool Use (Chat): leaderboard

Scale SEAL evaluation of tool use in conversational settings, testing ability to select and chain tools for user requests.

Metric: Score. Source: scale.com. Saturation forecast: Estimated already saturated. 35 models tracked.

Top models

#ModelScoreOverall rank
1O3 Mini (High)63.45#272 (O3 Mini)
2Gemini 2.5 Pro (Preview 03-25)62.43#123
3O3 Mini (Medium)62.42#272 (O3 Mini)
4O1 Pro61.42#228
5DeepSeek R160.91#251
6O1 (2024-12-17)60.41#149
7DeepSeek V358.55#321
8Gemini 2.0 Pro (Preview 02-05)57.86#307
9Gemini 2.0 Flash (Thinking)57.36#342 (Gemini 2.0 Flash)
10GPT-4o (2024-08-06)56.85#336
11GPT-4.5 (Preview)56.34#244
12Claude 3.7 Sonnet (20250219)56.25#201
13Claude 3.5 Sonnet (20240620)56.06#299
14Claude 3.7 Sonnet (Thinking)55.32#249 (Claude 3.7 Sonnet)
15O1 Preview55.1#193

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=seal-agentic-tool-use-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.