MCP-Persona - Lark-Centric Cross-Server: leaderboard
MCP-Persona (ICML 2026) gives tool-calling agents personalized tasks, such as messaging a colleague found through a shared group, on 12 MCP servers simulated from real tool traces, with up to 20 rounds per task. The board is checkpoint accuracy in percent on tasks that coordinate Lark with other servers; higher is better.
Metric: Checkpoint accuracy (%): mean LLM-judged score (0, 0.5 or 1) of the sub-task checkpoints in a task, averaged over tasks, cross-server tasks centred on Lark; 173 human-verified personal-application tasks on 12 simulated MCP servers (Lark, Slack, WeCom, Notion, Obsidian, Rednote, Reddit, Instagram, email and search tools), up to 20 tool-calling rounds, GPT-4o judge; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 40.81 | #250 |
| 2 | Claude Opus 4.1 | 39.67 | #272 |
| 3 | GPT-5 | 37.67 | #167 |
| 4 | O3 | 34.64 | #228 |
| 5 | GPT-4o (2024-11-20) | 30.65 | #866 |
| 6 | O4 Mini | 30.43 | #353 |
| 7 | Qwen 3 235B A22B 2507 Instruct | 30.4 | #619 |
| 8 | Qwen3 Coder | 29.8 | #586 |
| 9 | DeepSeek V3 (0324) | 27.91 | #709 |
| 10 | Grok 4 | 26.78 | #307 |
| 11 | Gemini 2.5 Pro | 18.23 | #266 |
| 12 | Gemini 3 Pro | 14.6 | #137 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mcp-persona-lark-centric-cross-server · How It Works · Data refreshed daily, snapshot 2026-11-13.