FIKA-Bench (Agents) - Real-Life: leaderboard
The real-life split of FIKA-Bench (2026), photos from volunteers everyday scenes, answered by multimodal agents with search, browsing and reverse image search tools. Strict accuracy in percent from an LLM judge that accepts only answers at the required granularity; higher is better.
Metric: Real-life split average, strict answer accuracy (%) on FIKA-Bench, open-ended fine-grained recognition questions (311 images from decontaminated public fine-grained datasets and real-life photos, each answer backed by human-verified evidence URLs, kept after strong closed-book models failed); a text-only LLM judge counts only answers at the required granularity as correct, multimodal agents with tools; higher is better. Source: arxiv.org. Saturation forecast: Around July 2027. 2 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.5 397B A17B | 28.4 | #264 |
| 2 | Qwen3-VL-8B-Instruct-FP8 | 23.3 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=fika-bench-agents-real-life · How It Works · Data refreshed daily, snapshot 2026-11-21.