AppWorld-UL (Function Calling) - Scenario Goal Completion: leaderboard

Metric: Interactive scenario goal completion (%; share of task scenarios in which the agent completes every task variant under the same interaction checks; function-calling agent over the AppWorld app APIs; GPT-5.5 user simulator answering from a fixed knowledge set). Source: arxiv.org. Saturation forecast: Around 2030. 5 models tracked.

Top models

#ModelScore
1Qwen 3.7 Max13.9
2Claude Opus 4.712.2
3DeepSeek V4 Pro11.6
4Kimi K2.611
5GPT-5.5 (Medium)10.5

Interactive version: theaggregate.ai/benchmark?slug=appworld-ul-function-calling-scenario-goal-completion · How It Works · Data refreshed daily, snapshot 2026-09-29.