VideoFDB - Perception - Fluency: leaderboard
The fluency rubric of VideoFDB (Mazumdar et al., 2026) rates overall interaction quality: no talking over the user, no monologues and no nonsensical replies. 105 held-out test clips of seven nonverbal conversational dynamics, such as pauses, backchannels, laughter and interruptions, are streamed in real time to a full-duplex speech agent that also sees the user, at 1 FPS for most agents, and a gpt-4o judge scores each response from 0 to 5; higher is better.
Metric: gpt-4o judge score (0-5; the 105 held-out test clips of the seven nonverbal conversational dynamics scored for perception (237 clips of 11 dynamics in the full benchmark), streamed in real time; the judge reads the transcribed, time-stamped agent response with the clip annotations; overall interaction quality: talk-over, monologue, nonsensical responses; user audio and video streamed, video at 1 FPS (Mini-Omni2: one frame per user speech segment)). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Native Audio | 3.33 | |
| 2 | Gemini 3.1 Flash Live | 3.15 | |
| 3 | MiniCPM-o 4.5 | 3.03 | |
| 4 | gpt-realtime-mini | 2.91 | |
| 5 | gpt-realtime | 2.72 | |
| 6 | VITA-1.5 | 1.19 | #3043 |
| 7 | Mini-Omni2 | 0.65 |
Interactive version: theaggregate.ai/benchmark?slug=videofdb-perception-fluency · How It Works · Data refreshed daily, snapshot 2026-11-12.