BARISTA - Hand-Object Interaction: leaderboard

Metric: Interaction F1 (%, times 100) for recognizing which hand interacts with which object, with IoU at least 0.5 box matching, over 1,000 frozen frames on BARISTA, an egocentric coffee-preparation video dataset with verified per-frame scene graphs, zero-shot with shared task prompts, temperature 0.7 (GPT-5.4 mini at its fixed sampling), low thinking effort for the closed models, mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.

Top models

#ModelScore
1Gemma 4 31B75.8
2Qwen 3.5 27B75.3
3Qwen 3.5 9B64.2
4GPT-5.4 Mini (Low)19.3

Interactive version: theaggregate.ai/benchmark?slug=barista-hand-object-interaction · How It Works · Data refreshed daily, snapshot 2026-10-07.