MCP-Persona - Rednote-Centric Cross-Server: leaderboard
MCP-Persona (ICML 2026) gives tool-calling agents personalized tasks, such as messaging a colleague found through a shared group, on 12 MCP servers simulated from real tool traces, with up to 20 rounds per task. The board is checkpoint accuracy in percent on tasks that coordinate Rednote with other servers; higher is better.
Metric: Checkpoint accuracy (%): mean LLM-judged score (0, 0.5 or 1) of the sub-task checkpoints in a task, averaged over tasks, cross-server tasks centred on Rednote; 173 human-verified personal-application tasks on 12 simulated MCP servers (Lark, Slack, WeCom, Notion, Obsidian, Rednote, Reddit, Instagram, email and search tools), up to 20 tool-calling rounds, GPT-4o judge; higher is better. Source: arxiv.org. Saturation forecast: Around December 2027. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 42.37 | #250 |
| 2 | Claude Opus 4.1 | 34.7 | #272 |
| 3 | GPT-5 | 34.66 | #167 |
| 4 | O3 | 26.05 | #228 |
| 5 | O4 Mini | 25.25 | #353 |
| 6 | Qwen3 Coder | 23.57 | #586 |
| 7 | Gemini 3 Pro | 22.05 | #137 |
| 8 | GPT-4o (2024-11-20) | 20.29 | #866 |
| 9 | Grok 4 | 19.79 | #307 |
| 10 | Qwen 3 235B A22B 2507 Instruct | 19.25 | #619 |
| 11 | DeepSeek V3 (0324) | 18.89 | #709 |
| 12 | Gemini 2.5 Pro | 11.76 | #266 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=mcp-persona-rednote-centric-cross-server · How It Works · Data refreshed daily, snapshot 2026-11-13.