SFI-Bench - Functional Association: leaderboard

Metric: Accuracy (%) on the functional association questions, four-option multiple choice on egocentric indoor videos (ARKitScenes and ScanNet++ scans), zero-shot with the same prompt templates, models at their default configurations; answered directly with no tools; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 25 models tracked.

Top models

#ModelScore
1GPT-5.4 (High)76.2
2GPT-575.3
3Gemini 3.1 Pro (Preview)73.2
4O4 Mini68.5
5GPT-5.466.4
6Gemini 2.5 Pro65.5
7Qwen 3 VL 235B A22B (Thinking)60.9
8Qwen 3 VL 32B (Thinking)59.7
9Gemini 3.1 Flash Lite58.3
10Qwen 3 VL 32B Instruct55.5
11Qwen 3 VL 235B A22B Instruct55.5
12Gemini 2.5 Flash52.1
13Qwen 3 VL 8B (Thinking)48.3
14Qwen 3 VL 30B A3B (Thinking)46.6
15Qwen 3 VL 30B A3B Instruct46.2

Interactive version: theaggregate.ai/benchmark?slug=sfi-bench-functional-association · How It Works · Data refreshed daily, snapshot 2026-10-07.