VisSearch-Bench - Direct Answer - Accuracy: leaderboard
VisSearch-Bench (Tsinghua University and Ant Group, arXiv 2611.04894v1) gives multimodal models 204 human-written open-web visual search tasks in five search families. Unlike BrowseComp-VL or MM-BrowseComp, where an image mostly seeds a text search, its tasks require keeping several images, object identities and external facts linked over long searches: finding every item of a visually defined set, chaining dependent visual hops and telling near-identical candidates apart. Systems answer the English questions once per task (Pass@1); temperature 0 except GPT-5.5 and Claude Opus 4.8 (provider default); reasoning effort is not reported. Question access: the 204 scored tasks, input images, reference answers and scoring prompts are public on Hugging Face (antins-labs/VisSearch-Bench-v1). Direct Answer: the model answers from the question and its images alone, with no tools. Accuracy credits a task only when the whole final answer is correct and complete (%).
Metric: Complete-answer accuracy (%, 204 tasks). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.5 Flash (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 6.37 | |
| 2 | GPT-5.5 (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=provider default; effort unreported) | 6.37 | |
| 3 | Kimi K3 (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 5.88 | |
| 4 | Claude Opus 4.8 (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=provider default; effort unreported) | 4.9 | |
| 5 | GLM-5.3 Flash (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 3.92 | |
| 6 | Qwen3.8-Flash-Next (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported; listed as Qwen3.8-Flash in the paper text) | 3.43 | |
| 7 | MiniMax-M3 (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 2.45 | |
| 8 | Qwen 3.8 27B (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 2.45 | |
| 9 | Qwen 3.5 397B A17B (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported) | 1.96 | |
| 10 | DeepSeek V4.1 Flash (Benchmark Sweep Run: source=VisSearch-Bench; setting=Direct Answer, no tools; English questions; Pass@1; temperature=0; effort unreported; checkpoint date unstated) | 1.96 |
Interactive version: theaggregate.ai/benchmark?slug=vissearch-bench-direct-answer-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-12.