VibeSearchBench - Daily: leaderboard

The 100 everyday-scenario tasks of VibeSearchBench (Xiaohongshu, 2026), such as filtering products or games by changing requirements, where an agent searches over a multi-turn session with a simulated user and extracts a knowledge graph of its findings. Triplet F1 in percent against the annotated graph, judged by an LLM, mean of 3 runs, under the OpenClaw agent harness; higher is better.

Metric: Triplet F1 (%; an LLM judge matches the knowledge graph the agent extracts after a multi-turn session with a progressive-disclosure user simulator against the annotated ground-truth graph; OpenClaw agent harness; 100 everyday VibeSearch-Daily tasks; mean of 3 runs per task). Source: arxiv.org. Saturation forecast: Around March 2028. 7 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.628.04#100
2DeepSeek V4 Pro26.16#181
3Gemini 3.1 Pro (Preview)25.54#91
4Kimi K2.624.93#173
5Seed 2.0 Pro24.64#209
6Qwen 3.5 397B A17B21.77#242
7GPT-5.421.05#121

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=vibesearchbench-daily · How It Works · Data refreshed daily, snapshot 2026-11-12.